Apr 11 18:05:43 user nova-compute[82009]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 18:05:46 user nova-compute[82009]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82009) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 18:05:46 user nova-compute[82009]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82009) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 18:05:46 user nova-compute[82009]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82009) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 18:05:46 user nova-compute[82009]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 18:05:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:05:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:05:46 user nova-compute[82009]: INFO nova.virt.driver [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 18:05:47 user nova-compute[82009]: INFO nova.compute.provider_config [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Acquiring lock "singleton_lock" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Acquired lock "singleton_lock" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Releasing lock "singleton_lock" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Full set of CONF: {{(pid=82009) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ******************************************************************************** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Configuration options gathered from: {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ================================================================================ {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] allow_resize_to_same_host      = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] arq_binding_timeout            = 300 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] backdoor_port                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] backdoor_socket                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] block_device_allocate_retries  = 300 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] block_device_allocate_retries_interval = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cert                           = self.pem {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute_monitors               = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] config_dir                     = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] config_drive_format            = iso9660 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] config_source                  = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] console_host                   = user {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] control_exchange               = nova {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cpu_allocation_ratio           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] daemon                         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] debug                          = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] default_access_ip_network_name = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] default_availability_zone      = nova {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] default_ephemeral_format       = ext4 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] default_schedule_zone          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] disk_allocation_ratio          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] enable_new_services            = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] enabled_ssl_apis               = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] flat_injected                  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] force_config_drive             = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] force_raw_images               = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] graceful_shutdown_timeout      = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] heal_instance_info_cache_interval = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] host                           = user {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_build_timeout         = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_delete_interval       = 300 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_name_template         = instance-%08x {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_usage_audit           = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_usage_audit_period    = month {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] internal_service_availability_zone = internal {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] key                            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] live_migration_retry_count     = 30 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_config_append              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_dir                        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_file                       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_options                    = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_rotate_interval            = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_rotate_interval_type       = days {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] log_rotation_type              = none {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] long_rpc_timeout               = 1800 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] max_concurrent_builds          = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] max_concurrent_live_migrations = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] max_concurrent_snapshots       = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] max_local_block_devices        = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] max_logfile_count              = 30 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] max_logfile_size_mb            = 200 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] maximum_instance_delete_attempts = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metadata_listen                = 0.0.0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metadata_listen_port           = 8775 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metadata_workers               = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] migrate_max_retries            = -1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] mkisofs_cmd                    = genisoimage {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] my_ip                          = 10.0.0.210 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] network_allocate_retries       = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] osapi_compute_listen_port      = 8774 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] osapi_compute_unique_server_name_scope =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] osapi_compute_workers          = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] password_length                = 12 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] periodic_enable                = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] periodic_fuzzy_delay           = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] pointer_model                  = ps2mouse {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] preallocate_images             = none {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] publish_errors                 = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] pybasedir                      = /opt/stack/nova {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ram_allocation_ratio           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rate_limit_burst               = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rate_limit_except_level        = CRITICAL {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rate_limit_interval            = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reboot_timeout                 = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reclaim_instance_interval      = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] record                         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reimage_timeout_per_gb         = 20 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] report_interval                = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rescue_timeout                 = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reserved_host_cpus             = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reserved_host_disk_mb          = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reserved_host_memory_mb        = 512 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] reserved_huge_pages            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] resize_confirm_window          = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] resize_fs_using_block_device   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] resume_guests_state_on_host_boot = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rpc_response_timeout           = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] run_external_periodic_tasks    = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] running_deleted_instance_action = reap {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] running_deleted_instance_timeout = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler_instance_sync_interval = 120 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_down_time              = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] servicegroup_driver            = db {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] shelved_offload_time           = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] shelved_poll_interval          = 3600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] shutdown_timeout               = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] source_is_ipv6                 = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ssl_only                       = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] state_path                     = /opt/stack/data/nova {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] sync_power_state_interval      = 600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] sync_power_state_pool_size     = 1000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] syslog_log_facility            = LOG_USER {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] tempdir                        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] timeout_nbd                    = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] transport_url                  = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] update_resources_interval      = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_cow_images                 = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_eventlog                   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_journal                    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_json                       = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_rootwrap_daemon            = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_stderr                     = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] use_syslog                     = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vcpu_pin_set                   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plugging_is_fatal          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plugging_timeout           = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] virt_mkfs                      = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] volume_usage_poll_interval     = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] watch_log_file                 = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] web                            = /usr/share/spice-html5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_concurrency.disable_process_locking = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.auth_strategy              = keystone {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.compute_link_prefix        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.dhcp_domain                = novalocal {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.enable_instance_password   = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.glance_link_prefix         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.instance_list_per_project_cells = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.list_records_by_skipping_down_cells = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.local_metadata_per_cell    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.max_limit                  = 1000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.metadata_cache_expiration  = 15 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.neutron_default_tenant_id  = default {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.use_forwarded_for          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.use_neutron_default_nets   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_dynamic_targets = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_jsonfile_path   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.backend_argument         = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.config_prefix            = cache.oslo {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.dead_timeout             = 60.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.debug_cache_backend      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.enable_retry_client      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.enable_socket_keepalive  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.enabled                  = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.expiration_time          = 600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.hashclient_retry_attempts = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_dead_retry      = 300 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_password        =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_sasl_enabled    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.memcache_username        =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.proxies                  = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.retry_attempts           = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.retry_delay              = 0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.socket_keepalive_count   = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.socket_keepalive_idle    = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.socket_keepalive_interval = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.tls_allowed_ciphers      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.tls_cafile               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.tls_certfile             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.tls_enabled              = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cache.tls_keyfile              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.auth_section            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.auth_type               = password {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.cafile                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.certfile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.collect_timing          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.cross_az_attach         = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.debug                   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.endpoint_template       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.http_retries            = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.insecure                = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.keyfile                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.os_region_name          = RegionOne {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.split_loggers           = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cinder.timeout                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.cpu_dedicated_set      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.cpu_shared_set         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.image_type_exclude_list = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.resource_provider_association_refresh = 300 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.shutdown_retry_interval = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] conductor.workers              = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] console.allowed_origins        = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] console.ssl_ciphers            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] console.ssl_minimum_version    = default {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] consoleauth.token_ttl          = 600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.cafile                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.certfile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.collect_timing          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.connect_retries         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.connect_retry_delay     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.endpoint_override       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.insecure                = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.keyfile                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.max_version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.min_version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.region_name             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.service_name            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.service_type            = accelerator {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.split_loggers           = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.status_code_retries     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.timeout                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] cyborg.version                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.backend               = sqlalchemy {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.connection            = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.connection_debug      = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.connection_parameters =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.connection_recycle_time = 3600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.connection_trace      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.db_inc_retry_interval = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.db_max_retries        = 20 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.db_max_retry_interval = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.db_retry_interval     = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.max_overflow          = 50 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.max_pool_size         = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.max_retries           = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.mysql_enable_ndb      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.mysql_wsrep_sync_wait = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.pool_timeout          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.retry_interval        = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.slave_connection      = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] database.sqlite_synchronous    = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.backend           = sqlalchemy {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.connection        = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.connection_debug  = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.connection_parameters =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.connection_recycle_time = 3600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.connection_trace  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.db_inc_retry_interval = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.db_max_retries    = 20 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.db_max_retry_interval = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.db_retry_interval = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.max_overflow      = 50 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.max_pool_size     = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.max_retries       = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.mysql_enable_ndb  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.pool_timeout      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.retry_interval    = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.slave_connection  = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] api_database.sqlite_synchronous = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] devices.enabled_mdev_types     = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ephemeral_storage_encryption.enabled = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.api_servers             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.cafile                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.certfile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.collect_timing          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.connect_retries         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.connect_retry_delay     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.debug                   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.default_trusted_certificate_ids = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.enable_certificate_validation = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.enable_rbd_download     = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.endpoint_override       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.insecure                = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.keyfile                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.max_version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.min_version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.num_retries             = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.rbd_ceph_conf           =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.rbd_connect_timeout     = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.rbd_pool                =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.rbd_user                =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.region_name             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.service_name            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.service_type            = image {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.split_loggers           = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.status_code_retries     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.timeout                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.verify_glance_signatures = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] glance.version                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] guestfs.debug                  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.config_drive_cdrom      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.config_drive_inject_password = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.enable_remotefx         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.instances_path_share    =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.limit_cpu_features      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.use_multipath_io        = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.vswitch_name            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] mks.enabled                    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] image_cache.manager_interval   = 2400 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] image_cache.precache_concurrency = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] image_cache.remove_unused_base_images = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] image_cache.subdirectory_name  = _base {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.api_max_retries         = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.api_retry_interval      = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.auth_section            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.auth_type               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.cafile                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.certfile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.collect_timing          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.connect_retries         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.connect_retry_delay     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.endpoint_override       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.insecure                = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.keyfile                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.max_version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.min_version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.partition_key           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.peer_list               = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.region_name             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.serial_console_state_timeout = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.service_name            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.service_type            = baremetal {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.split_loggers           = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.status_code_retries     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.timeout                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ironic.version                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] key_manager.fixed_key          = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.barbican_api_version  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.barbican_endpoint     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.barbican_endpoint_type = public {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.barbican_region_name  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.cafile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.certfile              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.collect_timing        = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.insecure              = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.keyfile               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.number_of_retries     = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.retry_delay           = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.send_service_user_token = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.split_loggers         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.timeout               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.verify_ssl            = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican.verify_ssl_path       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.auth_section = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.auth_type = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.cafile   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.certfile = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.collect_timing = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.insecure = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.keyfile  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.split_loggers = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] barbican_service_user.timeout  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.approle_role_id          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.approle_secret_id        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.cafile                   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.certfile                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.collect_timing           = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.insecure                 = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.keyfile                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.kv_mountpoint            = secret {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.kv_version               = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.namespace                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.root_token_id            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.split_loggers            = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.ssl_ca_crt_file          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.timeout                  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.use_ssl                  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.cafile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.certfile              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.collect_timing        = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.connect_retries       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.connect_retry_delay   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.endpoint_override     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.insecure              = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.keyfile               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.max_version           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.min_version           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.region_name           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.service_name          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.service_type          = identity {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.split_loggers         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.status_code_retries   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.timeout               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] keystone.version               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.connection_uri         =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_mode               = custom {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: WARNING oslo_config.cfg [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_power_governor_high = performance {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_power_management   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.device_detach_attempts = 8 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.device_detach_timeout  = 20 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.disk_cachemodes        = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.disk_prefix            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.enabled_perf_events    = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.file_backed_memory     = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.gid_maps               = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.hw_disk_discard        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.hw_machine_type        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_rbd_pool        = rbd {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_type            = default {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.images_volume_group    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.inject_key             = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.inject_partition       = -2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.inject_password        = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.iscsi_iface            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.iser_use_multipath     = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_downtime = 500 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_inbound_addr = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_scheme  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_timeout_action = abort {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_tunnelled = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: WARNING oslo_config.cfg [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 18:05:47 user nova-compute[82009]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 18:05:47 user nova-compute[82009]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 18:05:47 user nova-compute[82009]: and ``live_migration_inbound_addr`` respectively.
Apr 11 18:05:47 user nova-compute[82009]: ).  Its value may be silently ignored in the future.
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.live_migration_with_native_tls = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.max_queues             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.nfs_mount_options      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.num_pcie_ports         = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.pmem_namespaces        = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.quobyte_client_cfg     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rbd_secret_uuid        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rbd_user               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rescue_image_id        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rescue_kernel_id       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.rx_queue_size          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.smbfs_mount_options    =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.snapshot_compression   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.snapshot_image_format  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.sparse_logical_volumes = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.swtpm_enabled          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.swtpm_group            = tss {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.swtpm_user             = tss {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.sysinfo_serial         = unique {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.tx_queue_size          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.uid_maps               = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.use_virtio_for_bridges = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.virt_type              = kvm {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.volume_clear           = zero {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.volume_clear_size      = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.volume_use_multipath   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_cache_path   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.auth_section           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.auth_type              = password {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.cafile                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.certfile               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.collect_timing         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.connect_retries        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.connect_retry_delay    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.default_floating_pool  = public {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.endpoint_override      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.extension_sync_interval = 600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.http_retries           = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.insecure               = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.keyfile                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.max_version            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.min_version            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.ovs_bridge             = br-int {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.physnets               = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.region_name            = RegionOne {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.service_metadata_proxy = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.service_name           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.service_type           = network {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.split_loggers          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.status_code_retries    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.timeout                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] neutron.version                = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] notifications.bdms_in_notifications = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] notifications.default_level    = INFO {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] notifications.notification_format = unversioned {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] notifications.notify_on_state_change = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] pci.alias                      = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] pci.device_spec                = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] pci.report_in_placement        = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.auth_section         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.auth_type            = password {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.cafile               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.certfile             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.collect_timing       = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.connect_retries      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.connect_retry_delay  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.default_domain_id    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.default_domain_name  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.domain_id            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.domain_name          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.endpoint_override    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.insecure             = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.keyfile              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.max_version          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.min_version          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.password             = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.project_domain_id    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.project_domain_name  = Default {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.project_id           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.project_name         = service {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.region_name          = RegionOne {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.service_name         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.service_type         = placement {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.split_loggers        = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.status_code_retries  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.system_scope         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.timeout              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.trust_id             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.user_domain_id       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.user_domain_name     = Default {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.user_id              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.username             = placement {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] placement.version              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.cores                    = 20 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.count_usage_from_placement = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.injected_file_content_bytes = 10240 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.injected_file_path_length = 255 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.injected_files           = 5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.instances                = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.key_pairs                = 100 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.metadata_items           = 128 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.ram                      = 51200 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.recheck_quota            = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.server_group_members     = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] quota.server_groups            = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rdp.enabled                    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.image_metadata_prefilter = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.max_attempts         = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.max_placement_results = 1000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.query_placement_for_availability_zone = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] scheduler.workers              = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.host_subset_size = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.isolated_hosts = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.isolated_images = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.pci_in_placement = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.track_instance_changes = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metrics.required               = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metrics.weight_multiplier      = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] metrics.weight_setting         = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] serial_console.enabled         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] serial_console.port_range      = 10000:20000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] serial_console.serialproxy_port = 6083 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.auth_section      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.auth_type         = password {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.cafile            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.certfile          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.collect_timing    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.insecure          = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.keyfile           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.send_service_user_token = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.split_loggers     = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] service_user.timeout           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.agent_enabled            = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.enabled                  = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.html5proxy_port          = 6082 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.image_compression        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.jpeg_compression         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.playback_compression     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.server_listen            = 127.0.0.1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.streaming_mode           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] spice.zlib_compression         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] upgrade_levels.baseapi         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] upgrade_levels.cert            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] upgrade_levels.compute         = auto {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] upgrade_levels.conductor       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] upgrade_levels.scheduler       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.cafile = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.certfile = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.insecure = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vendordata_dynamic_auth.timeout = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.api_retry_count         = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.ca_file                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.cache_prefix            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.cluster_name            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.connection_pool_size    = 10 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.console_delay_seconds   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.datastore_regex         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.host_ip                 = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.host_password           = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.host_port               = 443 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.host_username           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.insecure                = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.integration_bridge      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.maximum_objects         = 100 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.pbm_default_policy      = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.pbm_enabled             = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.pbm_wsdl_location       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.serial_port_proxy_uri   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.serial_port_service_uri = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.task_poll_interval      = 0.5 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.use_linked_clone        = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.vnc_keymap              = en-us {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.vnc_port                = 5900 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vmware.vnc_port_total          = 10000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.auth_schemes               = ['none'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.enabled                    = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.novncproxy_port            = 6080 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.vencrypt_ca_certs          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.vencrypt_client_cert       = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vnc.vencrypt_client_key        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.disable_rootwrap   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.enable_numa_live_migration = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.libvirt_disable_apic = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.client_socket_timeout     = 900 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.default_pool_size         = 1000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.keep_alive                = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.max_header_line           = 16384 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.ssl_ca_file               = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.ssl_cert_file             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.ssl_key_file              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.tcp_keepidle              = 600 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] zvm.ca_file                    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] zvm.cloud_connector_url        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] zvm.reachable_timeout          = 300 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.enforce_new_defaults = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.enforce_scope      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.policy_default_rule = default {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.connection_string     = messaging:// {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.enabled               = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.es_doc_type           = notification {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.es_scroll_size        = 10000 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.es_scroll_time        = 2m {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.filter_error_trace    = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.sentinel_service_name = mymaster {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.socket_timeout        = 0.1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] profiler.trace_sqlalchemy      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] remote_debug.host              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] remote_debug.port              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_notifications.retry = -1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.auth_section        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.auth_type           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.cafile              = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.certfile            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.collect_timing      = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.connect_retries     = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.connect_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.endpoint_id         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.endpoint_override   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.insecure            = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.keyfile             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.max_version         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.min_version         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.region_name         = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.service_name        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.service_type        = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.split_loggers       = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.status_code_retries = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.status_code_retry_delay = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.timeout             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.valid_interfaces    = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_limit.version             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_reports.file_event_handler = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] oslo_reports.log_dir           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_ovs_privileged.group  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] vif_plug_ovs_privileged.user   = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_ovs.isolate_vif         = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] os_brick.lock_path             = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] privsep_osbrick.capabilities   = [21] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] privsep_osbrick.group          = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] privsep_osbrick.helper_command = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] privsep_osbrick.user           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] nova_sys_admin.group           = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] nova_sys_admin.helper_command  = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] nova_sys_admin.user            = None {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG oslo_service.service [None req-bbb87439-f1b0-4825-b4d7-63f77a0bbbd1 None None] ******************************************************************************** {{(pid=82009) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 18:05:47 user nova-compute[82009]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Starting native event thread {{(pid=82009) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Starting green dispatch thread {{(pid=82009) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Starting connection event dispatch thread {{(pid=82009) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Connecting to libvirt: qemu:///system {{(pid=82009) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd3e2bc2680> {{(pid=82009) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd3e2bc2680> {{(pid=82009) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 18:05:47 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Connection event '1' reason 'None'
Apr 11 18:05:47 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 18:05:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.mount [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Initialising _HostMountState generation 0 {{(pid=82009) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 18:05:54 user nova-compute[82009]: INFO nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host capabilities <capabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <host>
Apr 11 18:05:54 user nova-compute[82009]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 18:05:54 user nova-compute[82009]:     <cpu>
Apr 11 18:05:54 user nova-compute[82009]:       <arch>x86_64</arch>
Apr 11 18:05:54 user nova-compute[82009]:       <model>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <microcode version='1070'/>
Apr 11 18:05:54 user nova-compute[82009]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='osxsave'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='invtsc'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='rsba'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 18:05:54 user nova-compute[82009]:       <pages unit='KiB' size='4'/>
Apr 11 18:05:54 user nova-compute[82009]:       <pages unit='KiB' size='2048'/>
Apr 11 18:05:54 user nova-compute[82009]:     </cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <power_management>
Apr 11 18:05:54 user nova-compute[82009]:       <suspend_mem/>
Apr 11 18:05:54 user nova-compute[82009]:       <suspend_disk/>
Apr 11 18:05:54 user nova-compute[82009]:       <suspend_hybrid/>
Apr 11 18:05:54 user nova-compute[82009]:     </power_management>
Apr 11 18:05:54 user nova-compute[82009]:     <iommu support='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <migration_features>
Apr 11 18:05:54 user nova-compute[82009]:       <live/>
Apr 11 18:05:54 user nova-compute[82009]:       <uri_transports>
Apr 11 18:05:54 user nova-compute[82009]:         <uri_transport>tcp</uri_transport>
Apr 11 18:05:54 user nova-compute[82009]:         <uri_transport>rdma</uri_transport>
Apr 11 18:05:54 user nova-compute[82009]:       </uri_transports>
Apr 11 18:05:54 user nova-compute[82009]:     </migration_features>
Apr 11 18:05:54 user nova-compute[82009]:     <topology>
Apr 11 18:05:54 user nova-compute[82009]:       <cells num='2'>
Apr 11 18:05:54 user nova-compute[82009]:         <cell id='0'>
Apr 11 18:05:54 user nova-compute[82009]:           <memory unit='KiB'>8189224</memory>
Apr 11 18:05:54 user nova-compute[82009]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 11 18:05:54 user nova-compute[82009]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 18:05:54 user nova-compute[82009]:           <distances>
Apr 11 18:05:54 user nova-compute[82009]:             <sibling id='0' value='10'/>
Apr 11 18:05:54 user nova-compute[82009]:             <sibling id='1' value='20'/>
Apr 11 18:05:54 user nova-compute[82009]:           </distances>
Apr 11 18:05:54 user nova-compute[82009]:           <cpus num='6'>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 18:05:54 user nova-compute[82009]:           </cpus>
Apr 11 18:05:54 user nova-compute[82009]:         </cell>
Apr 11 18:05:54 user nova-compute[82009]:         <cell id='1'>
Apr 11 18:05:54 user nova-compute[82009]:           <memory unit='KiB'>8218764</memory>
Apr 11 18:05:54 user nova-compute[82009]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 11 18:05:54 user nova-compute[82009]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 18:05:54 user nova-compute[82009]:           <distances>
Apr 11 18:05:54 user nova-compute[82009]:             <sibling id='0' value='20'/>
Apr 11 18:05:54 user nova-compute[82009]:             <sibling id='1' value='10'/>
Apr 11 18:05:54 user nova-compute[82009]:           </distances>
Apr 11 18:05:54 user nova-compute[82009]:           <cpus num='6'>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 18:05:54 user nova-compute[82009]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 18:05:54 user nova-compute[82009]:           </cpus>
Apr 11 18:05:54 user nova-compute[82009]:         </cell>
Apr 11 18:05:54 user nova-compute[82009]:       </cells>
Apr 11 18:05:54 user nova-compute[82009]:     </topology>
Apr 11 18:05:54 user nova-compute[82009]:     <cache>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 18:05:54 user nova-compute[82009]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 18:05:54 user nova-compute[82009]:     </cache>
Apr 11 18:05:54 user nova-compute[82009]:     <secmodel>
Apr 11 18:05:54 user nova-compute[82009]:       <model>apparmor</model>
Apr 11 18:05:54 user nova-compute[82009]:       <doi>0</doi>
Apr 11 18:05:54 user nova-compute[82009]:     </secmodel>
Apr 11 18:05:54 user nova-compute[82009]:     <secmodel>
Apr 11 18:05:54 user nova-compute[82009]:       <model>dac</model>
Apr 11 18:05:54 user nova-compute[82009]:       <doi>0</doi>
Apr 11 18:05:54 user nova-compute[82009]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 18:05:54 user nova-compute[82009]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 18:05:54 user nova-compute[82009]:     </secmodel>
Apr 11 18:05:54 user nova-compute[82009]:   </host>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='alpha'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>clipper</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='armv6l'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>spitz</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>nuri</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>kzm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sx1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>z2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>tosa</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>n810</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>n800</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>terrier</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>midway</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>microbit</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>verdex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>highbank</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>akita</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>connex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>collie</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='armv7l'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>spitz</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>nuri</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>kzm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sx1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>z2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>tosa</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>n810</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>n800</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>terrier</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>midway</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>microbit</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>verdex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>highbank</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>akita</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>connex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>collie</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='aarch64'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>spitz</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>nuri</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>kzm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sx1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>z2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>tosa</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>n810</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>n800</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>terrier</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>midway</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>microbit</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>verdex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>highbank</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>akita</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>connex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>collie</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <acpi default='on' toggle='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='cris'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='i686'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>isapc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>microvm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='kvm'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <pae/>
Apr 11 18:05:54 user nova-compute[82009]:       <nonpae/>
Apr 11 18:05:54 user nova-compute[82009]:       <acpi default='on' toggle='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:       <apic default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='m68k'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>an5206</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>q800</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='microblaze'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='microblazeel'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='mips'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='16'>malta</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='mipsel'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='16'>malta</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='mips64'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='16'>malta</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>pica61</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>magnum</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='mips64el'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='16'>malta</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>pica61</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>magnum</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='16'>boston</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='ppc'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mac99</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>40p</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>taihu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='ppc64'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>taihu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>40p</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mac99</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='ppc64le'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>taihu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>40p</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>mac99</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='riscv32'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='8'>spike</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='8'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='riscv64'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='8'>spike</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='8'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='s390x'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='sh4'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>shix</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>r2d</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='sh4eb'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>shix</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>r2d</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='sparc'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>LX</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='sparc64'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>niagara</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='x86_64'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>64</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='1'>isapc</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>microvm</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='kvm'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <acpi default='on' toggle='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:       <apic default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='xtensa'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>sim</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>kc705</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ml605</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx200</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx60</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]:   <guest>
Apr 11 18:05:54 user nova-compute[82009]:     <os_type>hvm</os_type>
Apr 11 18:05:54 user nova-compute[82009]:     <arch name='xtensaeb'>
Apr 11 18:05:54 user nova-compute[82009]:       <wordsize>32</wordsize>
Apr 11 18:05:54 user nova-compute[82009]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='4'>sim</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>kc705</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ml605</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>virt</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx200</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>lx60</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 18:05:54 user nova-compute[82009]:       <domain type='qemu'/>
Apr 11 18:05:54 user nova-compute[82009]:     </arch>
Apr 11 18:05:54 user nova-compute[82009]:     <features>
Apr 11 18:05:54 user nova-compute[82009]:       <cpuselection/>
Apr 11 18:05:54 user nova-compute[82009]:       <deviceboot/>
Apr 11 18:05:54 user nova-compute[82009]:       <disksnapshot default='on' toggle='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     </features>
Apr 11 18:05:54 user nova-compute[82009]:   </guest>
Apr 11 18:05:54 user nova-compute[82009]: </capabilities>
Apr 11 18:05:54 user nova-compute[82009]: 
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-q35-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>i686</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='288'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'/>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='lm'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-i440fx-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>i686</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='255'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'/>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='lm'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ide</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-q35-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>i686</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='288'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'/>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='lm'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-i440fx-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>i686</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='255'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'/>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='lm'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ide</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-q35-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>x86_64</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='288'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>efi</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='invtsc'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='rsba'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-i440fx-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>x86_64</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='255'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>efi</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='invtsc'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='rsba'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ide</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-q35-jammy</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>x86_64</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='288'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>efi</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='invtsc'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='rsba'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 18:05:54 user nova-compute[82009]: <domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 18:05:54 user nova-compute[82009]:   <domain>kvm</domain>
Apr 11 18:05:54 user nova-compute[82009]:   <machine>pc-i440fx-6.2</machine>
Apr 11 18:05:54 user nova-compute[82009]:   <arch>x86_64</arch>
Apr 11 18:05:54 user nova-compute[82009]:   <vcpu max='255'/>
Apr 11 18:05:54 user nova-compute[82009]:   <iothreads supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:   <os supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='firmware'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>efi</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:     <loader supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>rom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pflash</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='readonly'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>yes</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='secure'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>no</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </loader>
Apr 11 18:05:54 user nova-compute[82009]:   </os>
Apr 11 18:05:54 user nova-compute[82009]:   <cpu>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-passthrough' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='hostPassthroughMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='maximum' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='maximumMigratable'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>on</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>off</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='host-model' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <vendor>Intel</vendor>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ss'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='vmx'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pcid'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='hypervisor'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arat'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='umip'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='md-clear'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='invtsc'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibpb'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='ibrs'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-stibp'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='rsba'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='erms'/>
Apr 11 18:05:54 user nova-compute[82009]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:     <mode name='custom' supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>qemu64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>qemu32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>phenom</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>pentium</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>n270</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm64</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>kvm32</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>coreduo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>core2duo</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>athlon</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Westmere</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Snowridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Skylake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>SandyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Penryn</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G5</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G4</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G3</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Opteron_G2</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Opteron_G1</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>IvyBridge</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Icelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Haswell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Rome</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-Milan</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>EPYC</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Dhyana</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cooperlake</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>Conroe</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='no'>Broadwell</model>
Apr 11 18:05:54 user nova-compute[82009]:       <model usable='yes'>486</model>
Apr 11 18:05:54 user nova-compute[82009]:     </mode>
Apr 11 18:05:54 user nova-compute[82009]:   </cpu>
Apr 11 18:05:54 user nova-compute[82009]:   <memoryBacking supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:     <enum name='sourceType'>
Apr 11 18:05:54 user nova-compute[82009]:       <value>file</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>anonymous</value>
Apr 11 18:05:54 user nova-compute[82009]:       <value>memfd</value>
Apr 11 18:05:54 user nova-compute[82009]:     </enum>
Apr 11 18:05:54 user nova-compute[82009]:   </memoryBacking>
Apr 11 18:05:54 user nova-compute[82009]:   <devices>
Apr 11 18:05:54 user nova-compute[82009]:     <disk supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='diskDevice'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>disk</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cdrom</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>floppy</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>lun</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='bus'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ide</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>fdc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sata</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </disk>
Apr 11 18:05:54 user nova-compute[82009]:     <graphics supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='type'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>sdl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vnc</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>spice</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egl-headless</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </graphics>
Apr 11 18:05:54 user nova-compute[82009]:     <video supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='modelType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>cirrus</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>vmvga</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>qxl</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>none</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>bochs</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>ramfb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </video>
Apr 11 18:05:54 user nova-compute[82009]:     <hostdev supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='mode'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>subsystem</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='startupPolicy'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>default</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>mandatory</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>requisite</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>optional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='subsysType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>usb</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>pci</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>scsi</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='capsType'/>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='pciBackend'/>
Apr 11 18:05:54 user nova-compute[82009]:     </hostdev>
Apr 11 18:05:54 user nova-compute[82009]:     <rng supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtio-non-transitional</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>random</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>egd</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>builtin</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </rng>
Apr 11 18:05:54 user nova-compute[82009]:     <filesystem supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='driverType'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>path</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>handle</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>virtiofs</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </filesystem>
Apr 11 18:05:54 user nova-compute[82009]:     <tpm supported='yes'>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='model'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-tis</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>tpm-crb</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:       <enum name='backendModel'>
Apr 11 18:05:54 user nova-compute[82009]:         <value>passthrough</value>
Apr 11 18:05:54 user nova-compute[82009]:         <value>emulator</value>
Apr 11 18:05:54 user nova-compute[82009]:       </enum>
Apr 11 18:05:54 user nova-compute[82009]:     </tpm>
Apr 11 18:05:54 user nova-compute[82009]:   </devices>
Apr 11 18:05:54 user nova-compute[82009]:   <features>
Apr 11 18:05:54 user nova-compute[82009]:     <gic supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:     <vmcoreinfo supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <genid supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backingStoreInput supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <backup supported='yes'/>
Apr 11 18:05:54 user nova-compute[82009]:     <sev supported='no'/>
Apr 11 18:05:54 user nova-compute[82009]:   </features>
Apr 11 18:05:54 user nova-compute[82009]: </domainCapabilities>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82009) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82009) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Checking secure boot support for host arch (x86_64) {{(pid=82009) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 18:05:54 user nova-compute[82009]: INFO nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Secure Boot support detected
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] cpu compare xml: <cpu match="exact">
Apr 11 18:05:54 user nova-compute[82009]:   <model>Nehalem</model>
Apr 11 18:05:54 user nova-compute[82009]: </cpu>
Apr 11 18:05:54 user nova-compute[82009]:  {{(pid=82009) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 18:05:54 user nova-compute[82009]: INFO nova.virt.node [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Generated node identity c90f7e3d-8e75-47f9-93b3-09ecdef87e26
Apr 11 18:05:54 user nova-compute[82009]: INFO nova.virt.node [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Wrote node identity c90f7e3d-8e75-47f9-93b3-09ecdef87e26 to /opt/stack/data/nova/compute_id
Apr 11 18:05:54 user nova-compute[82009]: WARNING nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Compute nodes ['c90f7e3d-8e75-47f9-93b3-09ecdef87e26'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 18:05:54 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 18:05:54 user nova-compute[82009]: WARNING nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 18:05:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:05:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:05:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:05:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Hypervisor/Node resource view: name=user free_ram=10807MB free_disk=27.23196029663086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:05:55 user nova-compute[82009]: WARNING nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] No compute node record for user:c90f7e3d-8e75-47f9-93b3-09ecdef87e26: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host c90f7e3d-8e75-47f9-93b3-09ecdef87e26 could not be found.
Apr 11 18:05:55 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Compute node record created for user:user with uuid: c90f7e3d-8e75-47f9-93b3-09ecdef87e26
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:05:55 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [req-4a9609d5-dad2-4971-8ce8-862f9268e403] Created resource provider record via placement API for resource provider with UUID c90f7e3d-8e75-47f9-93b3-09ecdef87e26 and name user.
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82009) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 18:05:55 user nova-compute[82009]: INFO nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] kernel doesn't support AMD SEV
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Libvirt baseline CPU <cpu>
Apr 11 18:05:55 user nova-compute[82009]:   <arch>x86_64</arch>
Apr 11 18:05:55 user nova-compute[82009]:   <model>Nehalem</model>
Apr 11 18:05:55 user nova-compute[82009]:   <vendor>Intel</vendor>
Apr 11 18:05:55 user nova-compute[82009]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 18:05:55 user nova-compute[82009]: </cpu>
Apr 11 18:05:55 user nova-compute[82009]:  {{(pid=82009) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Updated inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Updating resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 generation from 0 to 1 during operation: update_inventory {{(pid=82009) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Updating resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 generation from 1 to 2 during operation: update_traits {{(pid=82009) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.service [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Creating RPC server for service compute {{(pid=82009) start /opt/stack/nova/nova/service.py:182}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.service [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Join ServiceGroup membership for this service compute {{(pid=82009) start /opt/stack/nova/nova/service.py:199}}
Apr 11 18:05:55 user nova-compute[82009]: DEBUG nova.servicegroup.drivers.db [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82009) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 18:06:32 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_power_states {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:32 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:06:46 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:06:47 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:06:47 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:06:47 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=10209MB free_disk=27.145774841308594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:06:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:07:48 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:07:49 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:07:49 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:07:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=10152MB free_disk=27.191627502441406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:07:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:08:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:08:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:08:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:08:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:08:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:08:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:08:48 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:08:49 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:08:49 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:08:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=10146MB free_disk=26.968013763427734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:08:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:08:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:08:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:08:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:47 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:09:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:09:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:09:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:09:49 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:09:50 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:09:50 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:09:50 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=9429MB free_disk=26.990379333496094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:09:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:09:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:09:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:09:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "ce16e1aa-f16b-40be-945a-78265fb23638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:03 user nova-compute[82009]: INFO nova.compute.claims [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Claim successful on node user
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.044s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:03 user nova-compute[82009]: INFO nova.compute.claims [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Claim successful on node user
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Creating image(s)
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Creating image(s)
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "/opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "/opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "216db027-e3a6-4027-9aa7-07031623c674" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.policy [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20dbffe38f4e4be08599eb1f2fa2bc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba695867a2a94155820b99174b93499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.policy [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.part --force-share --output=json" returned: 0 in 0.125s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.virt.images [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 6a1872eb-6a9a-4f78-b970-289fd877ea0f was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.part /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:04 user nova-compute[82009]: INFO nova.compute.claims [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Claim successful on node user
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.part /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.converted" returned: 0 in 0.122s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.185s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:05 user nova-compute[82009]: INFO oslo.privsep.daemon [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa52k98m9/privsep.sock']
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.025s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:05 user sudo[90738]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa52k98m9/privsep.sock
Apr 11 18:10:05 user sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:05 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:05 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Creating image(s)
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:05 user nova-compute[82009]: DEBUG nova.policy [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:06 user sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 11 18:10:06 user nova-compute[82009]: INFO oslo.privsep.daemon [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Spawned new privsep daemon via rootwrap
Apr 11 18:10:06 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 18:10:06 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 18:10:06 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 18:10:06 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90743
Apr 11 18:10:06 user nova-compute[82009]: WARNING oslo_privsep.priv_context [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] privsep daemon already running
Apr 11 18:10:06 user nova-compute[82009]: WARNING oslo_privsep.priv_context [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] privsep daemon already running
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.123s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.126s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk 1073741824" returned: 0 in 0.040s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.142s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk 1073741824" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.381s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Cannot resize image /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.objects.instance [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'migration_context' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Ensure instance console log exists: /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Successfully created port: 3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk 1073741824" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Cannot resize image /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lazy-loading 'migration_context' on Instance uuid ce16e1aa-f16b-40be-945a-78265fb23638 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Ensure instance console log exists: /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Successfully created port: 8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Cannot resize image /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'migration_context' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Ensure instance console log exists: /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Successfully created port: 416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:09 user nova-compute[82009]: INFO nova.compute.claims [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Claim successful on node user
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.policy [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fd5ab7a54de4c7eae01368522ec9b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972a578943144e9d8b27c8c1367a7ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Creating image(s)
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "/opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "/opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "/opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk 1073741824" returned: 0 in 0.066s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:10 user nova-compute[82009]: INFO nova.compute.claims [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Claim successful on node user
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Cannot resize image /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lazy-loading 'migration_context' on Instance uuid b35fb527-2e5c-449f-a5d5-339595f3dc75 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Ensure instance console log exists: /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Successfully updated port: 416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Creating image(s)
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Successfully updated port: 8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.116s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquired lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-changed-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Refreshing instance network info cache due to event network-changed-416d3421-181a-44dd-9e4c-438c8289541d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Acquiring lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.policy [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e62201c2b4e4763bae71280d81ff5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964624241aac4d7ba6b2b9ffca6e7d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk 1073741824" returned: 0 in 0.068s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-changed-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Refreshing instance network info cache due to event network-changed-8e220357-3dfe-4e09-a0d7-2a3f519a9971. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Acquiring lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Cannot resize image /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'migration_context' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Ensure instance console log exists: /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance network_info: |[{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Acquired lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.neutron [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Refreshing network info cache for port 416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Start _get_guest_xml network_info=[{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1852666843',display_name='tempest-ServerRescueNegativeTestJSON-server-1852666843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1852666843',id=3,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xxj14qfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:05Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=216db027-e3a6-4027-9aa7-07031623c674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'pci_devices' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:12 user nova-compute[82009]:   <uuid>216db027-e3a6-4027-9aa7-07031623c674</uuid>
Apr 11 18:10:12 user nova-compute[82009]:   <name>instance-00000003</name>
Apr 11 18:10:12 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:12 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:12 user nova-compute[82009]:   <metadata>
Apr 11 18:10:12 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:12 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:12 user nova-compute[82009]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1852666843</nova:name>
Apr 11 18:10:12 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:12</nova:creationTime>
Apr 11 18:10:12 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:12 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:12 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:12 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:user uuid="908e0b5a1ce14f5cb636eda79ac77f7b">tempest-ServerRescueNegativeTestJSON-223229619-project-member</nova:user>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:project uuid="c10b5a531bbc41d680d137a766a8b2d9">tempest-ServerRescueNegativeTestJSON-223229619</nova:project>
Apr 11 18:10:12 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:12 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:12 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:12 user nova-compute[82009]:         <nova:port uuid="416d3421-181a-44dd-9e4c-438c8289541d">
Apr 11 18:10:12 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:10:12 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:12 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:12 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:12 user nova-compute[82009]:   </metadata>
Apr 11 18:10:12 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:12 user nova-compute[82009]:     <system>
Apr 11 18:10:12 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:12 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:12 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:12 user nova-compute[82009]:       <entry name="serial">216db027-e3a6-4027-9aa7-07031623c674</entry>
Apr 11 18:10:12 user nova-compute[82009]:       <entry name="uuid">216db027-e3a6-4027-9aa7-07031623c674</entry>
Apr 11 18:10:12 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:12 user nova-compute[82009]:     </system>
Apr 11 18:10:12 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:12 user nova-compute[82009]:   <os>
Apr 11 18:10:12 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:12 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:12 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:12 user nova-compute[82009]:   </os>
Apr 11 18:10:12 user nova-compute[82009]:   <features>
Apr 11 18:10:12 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:12 user nova-compute[82009]:     <apic/>
Apr 11 18:10:12 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:12 user nova-compute[82009]:   </features>
Apr 11 18:10:12 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:12 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:12 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:12 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:12 user nova-compute[82009]:   </clock>
Apr 11 18:10:12 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:12 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:12 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:12 user nova-compute[82009]:   </cpu>
Apr 11 18:10:12 user nova-compute[82009]:   <devices>
Apr 11 18:10:12 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:12 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:12 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk"/>
Apr 11 18:10:12 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:12 user nova-compute[82009]:     </disk>
Apr 11 18:10:12 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:12 user nova-compute[82009]:       <mac address="fa:16:3e:c0:ca:b6"/>
Apr 11 18:10:12 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:12 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:12 user nova-compute[82009]:       <target dev="tap416d3421-18"/>
Apr 11 18:10:12 user nova-compute[82009]:     </interface>
Apr 11 18:10:12 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:12 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/console.log" append="off"/>
Apr 11 18:10:12 user nova-compute[82009]:     </serial>
Apr 11 18:10:12 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:12 user nova-compute[82009]:     <video>
Apr 11 18:10:12 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:12 user nova-compute[82009]:     </video>
Apr 11 18:10:12 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:12 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:12 user nova-compute[82009]:     </rng>
Apr 11 18:10:12 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:12 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:12 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:12 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:12 user nova-compute[82009]:   </devices>
Apr 11 18:10:12 user nova-compute[82009]: </domain>
Apr 11 18:10:12 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1852666843',display_name='tempest-ServerRescueNegativeTestJSON-server-1852666843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1852666843',id=3,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xxj14qfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:05Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=216db027-e3a6-4027-9aa7-07031623c674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG os_vif [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Created schema index Interface.name {{(pid=82009) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Created schema index Port.name {{(pid=82009) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Created schema index Bridge.name {{(pid=82009) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [POLLOUT] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:12 user nova-compute[82009]: INFO oslo.privsep.daemon [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpdjrbmeh5/privsep.sock']
Apr 11 18:10:12 user sudo[90825]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpdjrbmeh5/privsep.sock
Apr 11 18:10:12 user sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 18:10:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Successfully created port: 77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Successfully updated port: 3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updating instance_info_cache with network_info: [{"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Releasing lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Instance network_info: |[{"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Acquired lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Refreshing network info cache for port 8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Start _get_guest_xml network_info=[{"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:13 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:13 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-666810633',display_name='tempest-VolumesActionsTest-instance-666810633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-666810633',id=2,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba695867a2a94155820b99174b93499b',ramdisk_id='',reservation_id='r-hcgz31f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1624489732',owner_user_name='tempest-VolumesActionsTest-1624489732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:04Z,user_data=None,user_id='20dbffe38f4e4be08599eb1f2fa2bc38',uuid=ce16e1aa-f16b-40be-945a-78265fb23638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Converting VIF {"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lazy-loading 'pci_devices' on Instance uuid ce16e1aa-f16b-40be-945a-78265fb23638 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:13 user nova-compute[82009]:   <uuid>ce16e1aa-f16b-40be-945a-78265fb23638</uuid>
Apr 11 18:10:13 user nova-compute[82009]:   <name>instance-00000002</name>
Apr 11 18:10:13 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:13 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:13 user nova-compute[82009]:   <metadata>
Apr 11 18:10:13 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:13 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:13 user nova-compute[82009]:       <nova:name>tempest-VolumesActionsTest-instance-666810633</nova:name>
Apr 11 18:10:13 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:13</nova:creationTime>
Apr 11 18:10:13 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:13 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:13 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:13 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:user uuid="20dbffe38f4e4be08599eb1f2fa2bc38">tempest-VolumesActionsTest-1624489732-project-member</nova:user>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:project uuid="ba695867a2a94155820b99174b93499b">tempest-VolumesActionsTest-1624489732</nova:project>
Apr 11 18:10:13 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:13 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:13 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:13 user nova-compute[82009]:         <nova:port uuid="8e220357-3dfe-4e09-a0d7-2a3f519a9971">
Apr 11 18:10:13 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 18:10:13 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:13 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:13 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:13 user nova-compute[82009]:   </metadata>
Apr 11 18:10:13 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:13 user nova-compute[82009]:     <system>
Apr 11 18:10:13 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:13 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:13 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:13 user nova-compute[82009]:       <entry name="serial">ce16e1aa-f16b-40be-945a-78265fb23638</entry>
Apr 11 18:10:13 user nova-compute[82009]:       <entry name="uuid">ce16e1aa-f16b-40be-945a-78265fb23638</entry>
Apr 11 18:10:13 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:13 user nova-compute[82009]:     </system>
Apr 11 18:10:13 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:13 user nova-compute[82009]:   <os>
Apr 11 18:10:13 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:13 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:13 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:13 user nova-compute[82009]:   </os>
Apr 11 18:10:13 user nova-compute[82009]:   <features>
Apr 11 18:10:13 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:13 user nova-compute[82009]:     <apic/>
Apr 11 18:10:13 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:13 user nova-compute[82009]:   </features>
Apr 11 18:10:13 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:13 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:13 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:13 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:13 user nova-compute[82009]:   </clock>
Apr 11 18:10:13 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:13 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:13 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:13 user nova-compute[82009]:   </cpu>
Apr 11 18:10:13 user nova-compute[82009]:   <devices>
Apr 11 18:10:13 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:13 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:13 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk"/>
Apr 11 18:10:13 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:13 user nova-compute[82009]:     </disk>
Apr 11 18:10:13 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:13 user nova-compute[82009]:       <mac address="fa:16:3e:0f:79:82"/>
Apr 11 18:10:13 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:13 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:13 user nova-compute[82009]:       <target dev="tap8e220357-3d"/>
Apr 11 18:10:13 user nova-compute[82009]:     </interface>
Apr 11 18:10:13 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:13 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/console.log" append="off"/>
Apr 11 18:10:13 user nova-compute[82009]:     </serial>
Apr 11 18:10:13 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:13 user nova-compute[82009]:     <video>
Apr 11 18:10:13 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:13 user nova-compute[82009]:     </video>
Apr 11 18:10:13 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:13 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:13 user nova-compute[82009]:     </rng>
Apr 11 18:10:13 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:13 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:13 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:13 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:13 user nova-compute[82009]:   </devices>
Apr 11 18:10:13 user nova-compute[82009]: </domain>
Apr 11 18:10:13 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-666810633',display_name='tempest-VolumesActionsTest-instance-666810633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-666810633',id=2,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba695867a2a94155820b99174b93499b',ramdisk_id='',reservation_id='r-hcgz31f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1624489732',owner_user_name='tempest-VolumesActionsTest-1624489732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:04Z,user_data=None,user_id='20dbffe38f4e4be08599eb1f2fa2bc38',uuid=ce16e1aa-f16b-40be-945a-78265fb23638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Converting VIF {"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG os_vif [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-changed-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Refreshing instance network info cache due to event network-changed-3097aae4-0511-4a73-883d-3366bfa914b7. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updated VIF entry in instance network info cache for port 416d3421-181a-44dd-9e4c-438c8289541d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-75be95c5-fea7-46f2-b84d-888cbbf1ee69 req-40bd9c6b-f69d-41e9-8ed2-d64f3da29198 service nova] Releasing lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:14 user sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 11 18:10:14 user nova-compute[82009]: INFO oslo.privsep.daemon [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Spawned new privsep daemon via rootwrap
Apr 11 18:10:14 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 18:10:14 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 18:10:14 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 18:10:14 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90848
Apr 11 18:10:14 user nova-compute[82009]: WARNING oslo_privsep.priv_context [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] privsep daemon already running
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance network_info: |[{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Refreshing network info cache for port 3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Start _get_guest_xml network_info=[{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1892408024',display_name='tempest-ServerRescueNegativeTestJSON-server-1892408024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1892408024',id=1,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xt0f3of7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:04Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=253a1b67-06b0-4308-a2fc-78f36cda0ab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'pci_devices' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:14 user nova-compute[82009]:   <uuid>253a1b67-06b0-4308-a2fc-78f36cda0ab8</uuid>
Apr 11 18:10:14 user nova-compute[82009]:   <name>instance-00000001</name>
Apr 11 18:10:14 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:14 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:14 user nova-compute[82009]:   <metadata>
Apr 11 18:10:14 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:14 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:14 user nova-compute[82009]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1892408024</nova:name>
Apr 11 18:10:14 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:14</nova:creationTime>
Apr 11 18:10:14 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:14 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:14 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:14 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:user uuid="908e0b5a1ce14f5cb636eda79ac77f7b">tempest-ServerRescueNegativeTestJSON-223229619-project-member</nova:user>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:project uuid="c10b5a531bbc41d680d137a766a8b2d9">tempest-ServerRescueNegativeTestJSON-223229619</nova:project>
Apr 11 18:10:14 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:14 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:14 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:14 user nova-compute[82009]:         <nova:port uuid="3097aae4-0511-4a73-883d-3366bfa914b7">
Apr 11 18:10:14 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:10:14 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:14 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:14 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:14 user nova-compute[82009]:   </metadata>
Apr 11 18:10:14 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:14 user nova-compute[82009]:     <system>
Apr 11 18:10:14 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:14 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:14 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:14 user nova-compute[82009]:       <entry name="serial">253a1b67-06b0-4308-a2fc-78f36cda0ab8</entry>
Apr 11 18:10:14 user nova-compute[82009]:       <entry name="uuid">253a1b67-06b0-4308-a2fc-78f36cda0ab8</entry>
Apr 11 18:10:14 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:14 user nova-compute[82009]:     </system>
Apr 11 18:10:14 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:14 user nova-compute[82009]:   <os>
Apr 11 18:10:14 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:14 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:14 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:14 user nova-compute[82009]:   </os>
Apr 11 18:10:14 user nova-compute[82009]:   <features>
Apr 11 18:10:14 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:14 user nova-compute[82009]:     <apic/>
Apr 11 18:10:14 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:14 user nova-compute[82009]:   </features>
Apr 11 18:10:14 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:14 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:14 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:14 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:14 user nova-compute[82009]:   </clock>
Apr 11 18:10:14 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:14 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:14 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:14 user nova-compute[82009]:   </cpu>
Apr 11 18:10:14 user nova-compute[82009]:   <devices>
Apr 11 18:10:14 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:14 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:14 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk"/>
Apr 11 18:10:14 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:14 user nova-compute[82009]:     </disk>
Apr 11 18:10:14 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:14 user nova-compute[82009]:       <mac address="fa:16:3e:d9:29:78"/>
Apr 11 18:10:14 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:14 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:14 user nova-compute[82009]:       <target dev="tap3097aae4-05"/>
Apr 11 18:10:14 user nova-compute[82009]:     </interface>
Apr 11 18:10:14 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:14 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/console.log" append="off"/>
Apr 11 18:10:14 user nova-compute[82009]:     </serial>
Apr 11 18:10:14 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:14 user nova-compute[82009]:     <video>
Apr 11 18:10:14 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:14 user nova-compute[82009]:     </video>
Apr 11 18:10:14 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:14 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:14 user nova-compute[82009]:     </rng>
Apr 11 18:10:14 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:14 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:14 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:14 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:14 user nova-compute[82009]:   </devices>
Apr 11 18:10:14 user nova-compute[82009]: </domain>
Apr 11 18:10:14 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1892408024',display_name='tempest-ServerRescueNegativeTestJSON-server-1892408024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1892408024',id=1,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xt0f3of7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:04Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=253a1b67-06b0-4308-a2fc-78f36cda0ab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG os_vif [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap416d3421-18, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap416d3421-18, col_values=(('external_ids', {'iface-id': '416d3421-181a-44dd-9e4c-438c8289541d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ca:b6', 'vm-uuid': '216db027-e3a6-4027-9aa7-07031623c674'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: INFO os_vif [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18')
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e220357-3d, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e220357-3d, col_values=(('external_ids', {'iface-id': '8e220357-3dfe-4e09-a0d7-2a3f519a9971', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:79:82', 'vm-uuid': 'ce16e1aa-f16b-40be-945a-78265fb23638'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: INFO os_vif [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d')
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3097aae4-05, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3097aae4-05, col_values=(('external_ids', {'iface-id': '3097aae4-0511-4a73-883d-3366bfa914b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:29:78', 'vm-uuid': '253a1b67-06b0-4308-a2fc-78f36cda0ab8'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:15 user nova-compute[82009]: INFO os_vif [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05')
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:c0:ca:b6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] No VIF found with MAC fa:16:3e:0f:79:82, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:d9:29:78, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Successfully created port: 8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updated VIF entry in instance network info cache for port 8e220357-3dfe-4e09-a0d7-2a3f519a9971. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updating instance_info_cache with network_info: [{"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4baccf8b-823c-4259-b5cf-032c5a0a3639 req-8ad37ed9-4c91-4a8b-9a20-fb0706c6a70f service nova] Releasing lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Successfully updated port: 77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "refresh_cache-b35fb527-2e5c-449f-a5d5-339595f3dc75" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquired lock "refresh_cache-b35fb527-2e5c-449f-a5d5-339595f3dc75" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-changed-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Refreshing instance network info cache due to event network-changed-77e6da2b-db86-4426-8c43-a0c31e8f7d7b. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Acquiring lock "refresh_cache-b35fb527-2e5c-449f-a5d5-339595f3dc75" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:16 user nova-compute[82009]: INFO nova.compute.claims [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Claim successful on node user
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updated VIF entry in instance network info cache for port 3097aae4-0511-4a73-883d-3366bfa914b7. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0b57047-6a6c-4dd3-aba3-55addc34eb87 req-13b0462d-d65c-41ce-bd70-ba30161de9ba service nova] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Creating image(s)
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Updating instance_info_cache with network_info: [{"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Releasing lock "refresh_cache-b35fb527-2e5c-449f-a5d5-339595f3dc75" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Instance network_info: |[{"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Acquired lock "refresh_cache-b35fb527-2e5c-449f-a5d5-339595f3dc75" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Refreshing network info cache for port 77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Start _get_guest_xml network_info=[{"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:17 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:17 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-684803225',display_name='tempest-DeleteServersTestJSON-server-684803225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-684803225',id=4,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972a578943144e9d8b27c8c1367a7ab0',ramdisk_id='',reservation_id='r-pmxud2pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1250553535',owner_user_name='tempest-DeleteServersTestJSON-1250553535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:10Z,user_data=None,user_id='5fd5ab7a54de4c7eae01368522ec9b6f',uuid=b35fb527-2e5c-449f-a5d5-339595f3dc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Converting VIF {"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lazy-loading 'pci_devices' on Instance uuid b35fb527-2e5c-449f-a5d5-339595f3dc75 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.192s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:17 user nova-compute[82009]:   <uuid>b35fb527-2e5c-449f-a5d5-339595f3dc75</uuid>
Apr 11 18:10:17 user nova-compute[82009]:   <name>instance-00000004</name>
Apr 11 18:10:17 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:17 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:17 user nova-compute[82009]:   <metadata>
Apr 11 18:10:17 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:17 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:17 user nova-compute[82009]:       <nova:name>tempest-DeleteServersTestJSON-server-684803225</nova:name>
Apr 11 18:10:17 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:17</nova:creationTime>
Apr 11 18:10:17 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:17 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:17 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:17 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:user uuid="5fd5ab7a54de4c7eae01368522ec9b6f">tempest-DeleteServersTestJSON-1250553535-project-member</nova:user>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:project uuid="972a578943144e9d8b27c8c1367a7ab0">tempest-DeleteServersTestJSON-1250553535</nova:project>
Apr 11 18:10:17 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:17 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:17 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:17 user nova-compute[82009]:         <nova:port uuid="77e6da2b-db86-4426-8c43-a0c31e8f7d7b">
Apr 11 18:10:17 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:10:17 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:17 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:17 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:17 user nova-compute[82009]:   </metadata>
Apr 11 18:10:17 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:17 user nova-compute[82009]:     <system>
Apr 11 18:10:17 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:17 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:17 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:17 user nova-compute[82009]:       <entry name="serial">b35fb527-2e5c-449f-a5d5-339595f3dc75</entry>
Apr 11 18:10:17 user nova-compute[82009]:       <entry name="uuid">b35fb527-2e5c-449f-a5d5-339595f3dc75</entry>
Apr 11 18:10:17 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:17 user nova-compute[82009]:     </system>
Apr 11 18:10:17 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:17 user nova-compute[82009]:   <os>
Apr 11 18:10:17 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:17 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:17 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:17 user nova-compute[82009]:   </os>
Apr 11 18:10:17 user nova-compute[82009]:   <features>
Apr 11 18:10:17 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:17 user nova-compute[82009]:     <apic/>
Apr 11 18:10:17 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:17 user nova-compute[82009]:   </features>
Apr 11 18:10:17 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:17 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:17 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:17 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:17 user nova-compute[82009]:   </clock>
Apr 11 18:10:17 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:17 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:17 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:17 user nova-compute[82009]:   </cpu>
Apr 11 18:10:17 user nova-compute[82009]:   <devices>
Apr 11 18:10:17 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:17 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:17 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk"/>
Apr 11 18:10:17 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:17 user nova-compute[82009]:     </disk>
Apr 11 18:10:17 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:17 user nova-compute[82009]:       <mac address="fa:16:3e:68:a1:00"/>
Apr 11 18:10:17 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:17 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:17 user nova-compute[82009]:       <target dev="tap77e6da2b-db"/>
Apr 11 18:10:17 user nova-compute[82009]:     </interface>
Apr 11 18:10:17 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:17 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/console.log" append="off"/>
Apr 11 18:10:17 user nova-compute[82009]:     </serial>
Apr 11 18:10:17 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:17 user nova-compute[82009]:     <video>
Apr 11 18:10:17 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:17 user nova-compute[82009]:     </video>
Apr 11 18:10:17 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:17 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:17 user nova-compute[82009]:     </rng>
Apr 11 18:10:17 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:17 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:17 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:17 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:17 user nova-compute[82009]:   </devices>
Apr 11 18:10:17 user nova-compute[82009]: </domain>
Apr 11 18:10:17 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-684803225',display_name='tempest-DeleteServersTestJSON-server-684803225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-684803225',id=4,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972a578943144e9d8b27c8c1367a7ab0',ramdisk_id='',reservation_id='r-pmxud2pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1250553535',owner_user_name='tempest-DeleteServersTestJSON-1250553535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:10Z,user_data=None,user_id='5fd5ab7a54de4c7eae01368522ec9b6f',uuid=b35fb527-2e5c-449f-a5d5-339595f3dc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Converting VIF {"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG os_vif [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77e6da2b-db, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77e6da2b-db, col_values=(('external_ids', {'iface-id': '77e6da2b-db86-4426-8c43-a0c31e8f7d7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:a1:00', 'vm-uuid': 'b35fb527-2e5c-449f-a5d5-339595f3dc75'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk 1073741824" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:17 user nova-compute[82009]: INFO os_vif [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db')
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.policy [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] No VIF found with MAC fa:16:3e:68:a1:00, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Cannot resize image /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.objects.instance [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'migration_context' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Ensure instance console log exists: /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.network.neutron [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Updated VIF entry in instance network info cache for port 77e6da2b-db86-4426-8c43-a0c31e8f7d7b. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.network.neutron [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Updating instance_info_cache with network_info: [{"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9cb5211-2a4d-4704-8e90-49b86fbb7f04 req-7d10d8fc-e48a-482a-b0cd-85308cf53661 service nova] Releasing lock "refresh_cache-b35fb527-2e5c-449f-a5d5-339595f3dc75" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:19 user nova-compute[82009]: WARNING nova.compute.manager [req-84c46241-98c3-40cb-a03b-a6760759205a req-0125fdaa-17f1-4bb0-bbd5-bbd078fa7325 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state building and task_state spawning.
Apr 11 18:10:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Successfully updated port: 8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing instance network info cache due to event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:20 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance network_info: |[{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Start _get_guest_xml network_info=[{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:21 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:21 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977485148',display_name='tempest-ServerStableDeviceRescueTest-server-1977485148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977485148',id=5,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfbRQOA+YTKOQ+lZdoJpkrj7VvUUe/6HtKV2apcueDmrB+0261QbqAV8wZxYggyb2JZ0aCJhf8E6yndBbQDy5N2d5vbP3AMf66KfCVAJDPoSHsP3ioPNDUjt3X0FB0lfw==',key_name='tempest-keypair-1352570335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='964624241aac4d7ba6b2b9ffca6e7d8a',ramdisk_id='',reservation_id='r-vc38xagz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-465398083',owner_user_name='tempest-ServerStableDeviceRescueTest-465398083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e62201c2b4e4763bae71280d81ff5e4',uuid=1f3000ca-5a67-4814-bf9d-94415c8f3d9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converting VIF {"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:21 user nova-compute[82009]:   <uuid>1f3000ca-5a67-4814-bf9d-94415c8f3d9d</uuid>
Apr 11 18:10:21 user nova-compute[82009]:   <name>instance-00000005</name>
Apr 11 18:10:21 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:21 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:21 user nova-compute[82009]:   <metadata>
Apr 11 18:10:21 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:21 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:21 user nova-compute[82009]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1977485148</nova:name>
Apr 11 18:10:21 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:21</nova:creationTime>
Apr 11 18:10:21 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:21 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:21 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:21 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:user uuid="1e62201c2b4e4763bae71280d81ff5e4">tempest-ServerStableDeviceRescueTest-465398083-project-member</nova:user>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:project uuid="964624241aac4d7ba6b2b9ffca6e7d8a">tempest-ServerStableDeviceRescueTest-465398083</nova:project>
Apr 11 18:10:21 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:21 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:21 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:21 user nova-compute[82009]:         <nova:port uuid="8be7e2fa-afa5-4bb3-a32b-95a701a17a65">
Apr 11 18:10:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 18:10:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:21 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:21 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:21 user nova-compute[82009]:   </metadata>
Apr 11 18:10:21 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:21 user nova-compute[82009]:     <system>
Apr 11 18:10:21 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:21 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:21 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:21 user nova-compute[82009]:       <entry name="serial">1f3000ca-5a67-4814-bf9d-94415c8f3d9d</entry>
Apr 11 18:10:21 user nova-compute[82009]:       <entry name="uuid">1f3000ca-5a67-4814-bf9d-94415c8f3d9d</entry>
Apr 11 18:10:21 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:21 user nova-compute[82009]:     </system>
Apr 11 18:10:21 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:21 user nova-compute[82009]:   <os>
Apr 11 18:10:21 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:21 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:21 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:21 user nova-compute[82009]:   </os>
Apr 11 18:10:21 user nova-compute[82009]:   <features>
Apr 11 18:10:21 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:21 user nova-compute[82009]:     <apic/>
Apr 11 18:10:21 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:21 user nova-compute[82009]:   </features>
Apr 11 18:10:21 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:21 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:21 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:21 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:21 user nova-compute[82009]:   </clock>
Apr 11 18:10:21 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:21 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:21 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:21 user nova-compute[82009]:   </cpu>
Apr 11 18:10:21 user nova-compute[82009]:   <devices>
Apr 11 18:10:21 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:21 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:21 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk"/>
Apr 11 18:10:21 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:21 user nova-compute[82009]:     </disk>
Apr 11 18:10:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:21 user nova-compute[82009]:       <mac address="fa:16:3e:c5:06:91"/>
Apr 11 18:10:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:21 user nova-compute[82009]:       <target dev="tap8be7e2fa-af"/>
Apr 11 18:10:21 user nova-compute[82009]:     </interface>
Apr 11 18:10:21 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:21 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/console.log" append="off"/>
Apr 11 18:10:21 user nova-compute[82009]:     </serial>
Apr 11 18:10:21 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:21 user nova-compute[82009]:     <video>
Apr 11 18:10:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:21 user nova-compute[82009]:     </video>
Apr 11 18:10:21 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:21 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:21 user nova-compute[82009]:     </rng>
Apr 11 18:10:21 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:21 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:21 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:21 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:21 user nova-compute[82009]:   </devices>
Apr 11 18:10:21 user nova-compute[82009]: </domain>
Apr 11 18:10:21 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977485148',display_name='tempest-ServerStableDeviceRescueTest-server-1977485148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977485148',id=5,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfbRQOA+YTKOQ+lZdoJpkrj7VvUUe/6HtKV2apcueDmrB+0261QbqAV8wZxYggyb2JZ0aCJhf8E6yndBbQDy5N2d5vbP3AMf66KfCVAJDPoSHsP3ioPNDUjt3X0FB0lfw==',key_name='tempest-keypair-1352570335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='964624241aac4d7ba6b2b9ffca6e7d8a',ramdisk_id='',reservation_id='r-vc38xagz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-465398083',owner_user_name='tempest-ServerStableDeviceRescueTest-465398083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e62201c2b4e4763bae71280d81ff5e4',uuid=1f3000ca-5a67-4814-bf9d-94415c8f3d9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converting VIF {"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG os_vif [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:21 user nova-compute[82009]: WARNING nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state building and task_state spawning.
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] No waiting events found dispatching network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:21 user nova-compute[82009]: WARNING nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received unexpected event network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance with vm_state building and task_state spawning.
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] No waiting events found dispatching network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:21 user nova-compute[82009]: WARNING nova.compute.manager [req-a4ca1941-04cd-4f9b-8111-1258ccf01d84 req-41b39e2f-b4dc-48e2-a472-89f66c59bd77 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received unexpected event network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance with vm_state building and task_state spawning.
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8be7e2fa-af, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8be7e2fa-af, col_values=(('external_ids', {'iface-id': '8be7e2fa-afa5-4bb3-a32b-95a701a17a65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:06:91', 'vm-uuid': '1f3000ca-5a67-4814-bf9d-94415c8f3d9d'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: INFO os_vif [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af')
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No VIF found with MAC fa:16:3e:c5:06:91, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Successfully created port: 98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:22 user nova-compute[82009]: WARNING nova.compute.manager [req-538d0288-ce47-492e-b297-48548450b263 req-2e5d3b59-aa4e-46c1-aaed-8639b287c2cb service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state building and task_state spawning.
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236622.4967728, 216db027-e3a6-4027-9aa7-07031623c674 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] VM Resumed (Lifecycle Event)
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance spawned successfully.
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236622.5042064, 216db027-e3a6-4027-9aa7-07031623c674 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] VM Started (Lifecycle Event)
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Took 17.29 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:22 user nova-compute[82009]: INFO nova.compute.manager [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Took 18.13 seconds to build instance.
Apr 11 18:10:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a24f95bd-16e6-4c34-8f52-75d4a65ebf11 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "216db027-e3a6-4027-9aa7-07031623c674" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.696s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236623.6592975, ce16e1aa-f16b-40be-945a-78265fb23638 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] VM Resumed (Lifecycle Event)
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Instance spawned successfully.
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance spawned successfully.
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236623.6673405, ce16e1aa-f16b-40be-945a-78265fb23638 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] VM Started (Lifecycle Event)
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Took 19.84 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] No waiting events found dispatching network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:23 user nova-compute[82009]: WARNING nova.compute.manager [req-36b64035-6e83-49be-9217-c4f9b6f8e20a req-00a95626-67c1-4eb5-96be-59e033adace5 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received unexpected event network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance with vm_state building and task_state spawning.
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Took 20.04 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:23 user nova-compute[82009]: INFO nova.compute.manager [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Took 20.75 seconds to build instance.
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236623.6674976, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:24 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Resumed (Lifecycle Event)
Apr 11 18:10:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a5adc60c-0c27-4ca9-90a3-8167a45e7f28 tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "ce16e1aa-f16b-40be-945a-78265fb23638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.088s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:24 user nova-compute[82009]: INFO nova.compute.manager [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Took 21.15 seconds to build instance.
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-61f4d822-24f7-4c72-98b3-70b696223685 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.385s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236623.6702332, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:24 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Started (Lifecycle Event)
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:24 user nova-compute[82009]: WARNING nova.compute.manager [req-125738a2-f441-46d3-9694-42a10ee6d6d6 req-e828df58-8376-4ba9-8712-984269f4114c service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state active and task_state None.
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.network.neutron [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updated VIF entry in instance network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG nova.network.neutron [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a2534e32-ba6f-43fd-8910-a79240a6a9fd req-b20fe860-2497-4e8a-b8ff-c3f5c8a8b4db service nova] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236625.897663, b35fb527-2e5c-449f-a5d5-339595f3dc75 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] VM Resumed (Lifecycle Event)
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Instance spawned successfully.
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236625.8997996, b35fb527-2e5c-449f-a5d5-339595f3dc75 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] VM Started (Lifecycle Event)
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Took 16.29 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Took 17.26 seconds to build instance.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] No waiting events found dispatching network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:26 user nova-compute[82009]: WARNING nova.compute.manager [req-a5dd101e-887b-48b8-8b7c-839ae6d1cf20 req-c351eb16-b9de-49bf-a745-cdd48f565410 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received unexpected event network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance with vm_state active and task_state None.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f0cd1ed8-6db3-45c6-900c-6afdfcb2881a tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.429s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236626.4775486, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Resumed (Lifecycle Event)
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance spawned successfully.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236626.478678, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Started (Lifecycle Event)
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Took 15.71 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:26 user nova-compute[82009]: INFO nova.compute.manager [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Took 16.49 seconds to build instance.
Apr 11 18:10:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3d155f89-9b3d-4c6d-923b-459370f41f97 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.652s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Successfully updated port: 98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:27 user nova-compute[82009]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:28 user nova-compute[82009]: WARNING nova.compute.manager [req-fb70528b-c837-4758-9cb8-8aa7cec71bc4 req-72abe4ca-7f3e-4e7a-808f-b975cc100c4c service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state active and task_state None.
Apr 11 18:10:28 user nova-compute[82009]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:28 user nova-compute[82009]: INFO nova.compute.claims [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Claim successful on node user
Apr 11 18:10:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.network.neutron [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance network_info: |[{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start _get_guest_xml network_info=[{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:29 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:29 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-1599225915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.objects.instance [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_devices' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:29 user nova-compute[82009]:   <uuid>1adc9f1d-cc32-446e-9ffc-5fada2383164</uuid>
Apr 11 18:10:29 user nova-compute[82009]:   <name>instance-00000006</name>
Apr 11 18:10:29 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:29 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:29 user nova-compute[82009]:   <metadata>
Apr 11 18:10:29 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:29 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:29 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-1599225915</nova:name>
Apr 11 18:10:29 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:29</nova:creationTime>
Apr 11 18:10:29 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:29 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:29 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:29 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:10:29 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:29 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:29 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:29 user nova-compute[82009]:         <nova:port uuid="98cc8035-8d3e-47cf-9758-c7172120ac70">
Apr 11 18:10:29 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:10:29 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:29 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:29 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:29 user nova-compute[82009]:   </metadata>
Apr 11 18:10:29 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:29 user nova-compute[82009]:     <system>
Apr 11 18:10:29 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:29 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:29 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:29 user nova-compute[82009]:       <entry name="serial">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:10:29 user nova-compute[82009]:       <entry name="uuid">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:10:29 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:29 user nova-compute[82009]:     </system>
Apr 11 18:10:29 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:29 user nova-compute[82009]:   <os>
Apr 11 18:10:29 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:29 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:29 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:29 user nova-compute[82009]:   </os>
Apr 11 18:10:29 user nova-compute[82009]:   <features>
Apr 11 18:10:29 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:29 user nova-compute[82009]:     <apic/>
Apr 11 18:10:29 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:29 user nova-compute[82009]:   </features>
Apr 11 18:10:29 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:29 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:29 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:29 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:29 user nova-compute[82009]:   </clock>
Apr 11 18:10:29 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:29 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:29 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:29 user nova-compute[82009]:   </cpu>
Apr 11 18:10:29 user nova-compute[82009]:   <devices>
Apr 11 18:10:29 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:29 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:29 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk"/>
Apr 11 18:10:29 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:29 user nova-compute[82009]:     </disk>
Apr 11 18:10:29 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:29 user nova-compute[82009]:       <mac address="fa:16:3e:fd:e3:b5"/>
Apr 11 18:10:29 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:29 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:29 user nova-compute[82009]:       <target dev="tap98cc8035-8d"/>
Apr 11 18:10:29 user nova-compute[82009]:     </interface>
Apr 11 18:10:29 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:29 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log" append="off"/>
Apr 11 18:10:29 user nova-compute[82009]:     </serial>
Apr 11 18:10:29 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:29 user nova-compute[82009]:     <video>
Apr 11 18:10:29 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:29 user nova-compute[82009]:     </video>
Apr 11 18:10:29 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:29 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:29 user nova-compute[82009]:     </rng>
Apr 11 18:10:29 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:29 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:29 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:29 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:29 user nova-compute[82009]:   </devices>
Apr 11 18:10:29 user nova-compute[82009]: </domain>
Apr 11 18:10:29 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-1599225915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG os_vif [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cc8035-8d, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98cc8035-8d, col_values=(('external_ids', {'iface-id': '98cc8035-8d3e-47cf-9758-c7172120ac70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e3:b5', 'vm-uuid': '1adc9f1d-cc32-446e-9ffc-5fada2383164'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:29 user nova-compute[82009]: INFO os_vif [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:fd:e3:b5, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.995s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.743s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:29 user nova-compute[82009]: INFO nova.compute.claims [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Claim successful on node user
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Creating image(s)
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "/opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "/opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "/opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.policy [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6d4a1de4c8e49a0a14eec670db8ff0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19acb9280d2f48b59ad7b2fde0e4efb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-changed-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Refreshing instance network info cache due to event network-changed-98cc8035-8d3e-47cf-9758-c7172120ac70. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Refreshing network info cache for port 98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.324s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.942s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.262s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk 1073741824" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.396s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.policy [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b6375313b85465aa965faf4b75eec5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b181392922e741a784b8a0d59ca79f7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.204s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Cannot resize image /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG nova.objects.instance [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'migration_context' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Ensure instance console log exists: /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:31 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Creating image(s)
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "/opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "/opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "/opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "d4ef18d0ff111f163b842a00bc6dd94b683470aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "d4ef18d0ff111f163b842a00bc6dd94b683470aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:32 user nova-compute[82009]: WARNING nova.compute.manager [req-37cca6e3-303d-4407-a18b-8b5a0a74c794 req-2aa85e73-b074-47f0-bdd5-e06bbca5df99 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state building and task_state spawning.
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.part --force-share --output=json" returned: 0 in 0.318s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.virt.images [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] f23e66cf-31f3-42e5-a4a8-81cf2a978f9b was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.part /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.network.neutron [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updated VIF entry in instance network info cache for port 98cc8035-8d3e-47cf-9758-c7172120ac70. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.network.neutron [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:32 user nova-compute[82009]: WARNING nova.compute.manager [req-6ab2addd-3019-4d58-8496-175855166b66 req-2afef3e5-a9ea-4564-ad43-91046f20f69c service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state active and task_state None.
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.part /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.converted" returned: 0 in 0.253s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:32 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Successfully created port: 83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "d4ef18d0ff111f163b842a00bc6dd94b683470aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.622s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa --force-share --output=json" returned: 0 in 0.302s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "d4ef18d0ff111f163b842a00bc6dd94b683470aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "d4ef18d0ff111f163b842a00bc6dd94b683470aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Successfully created port: c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa --force-share --output=json" returned: 0 in 0.217s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa,backing_fmt=raw /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa,backing_fmt=raw /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk 1073741824" returned: 0 in 0.104s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "d4ef18d0ff111f163b842a00bc6dd94b683470aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa --force-share --output=json" returned: 0 in 0.205s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:34 user nova-compute[82009]: WARNING nova.compute.manager [req-7d00b3ec-2235-462b-9999-3df9aff65260 req-ab166e8f-fd51-4eb6-a4c7-3929c2768aaf service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state building and task_state spawning.
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Cannot resize image /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'migration_context' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Successfully updated port: 83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Ensure instance console log exists: /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-changed-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Refreshing instance network info cache due to event network-changed-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Acquiring lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Acquired lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Refreshing network info cache for port 83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236634.4756744, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Resumed (Lifecycle Event)
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance spawned successfully.
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236634.4800243, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Started (Lifecycle Event)
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Successfully updated port: c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquired lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-changed-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Refreshing instance network info cache due to event network-changed-c8a46ee6-74bb-42ed-a653-649dc130b0f3. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Acquiring lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Took 17.29 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:34 user nova-compute[82009]: INFO nova.compute.manager [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Took 18.12 seconds to build instance.
Apr 11 18:10:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d254e01e-aedf-4dea-8644-896c21378cf8 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.245s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.neutron [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updating instance_info_cache with network_info: [{"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Releasing lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Instance network_info: |[{"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Acquired lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.neutron [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Refreshing network info cache for port c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Start _get_guest_xml network_info=[{"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.neutron [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dfb98598-ff1f-4573-9310-8ce6700589cd req-d3b6a26d-691d-4d3e-891f-9071e5f42f2b service nova] Releasing lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquired lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:35 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:35 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-410575530',display_name='tempest-TestVolumeSwap-server-410575530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-410575530',id=7,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItze44OHRrzTJBXg4OENnJbauHoiu2rr3GWBqGL/9xCDLTcFJAl0TKCQF1smiP/y4xObggC6qDCPDzTrqWWOTF3SJ0yaeDG4pl0IVe4P1xS4HSXTcR8yMA4STp3p767Q==',key_name='tempest-keypair-1379978453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19acb9280d2f48b59ad7b2fde0e4efb3',ramdisk_id='',reservation_id='r-3rnkqan0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1807194571',owner_user_name='tempest-TestVolumeSwap-1807194571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6d4a1de4c8e49a0a14eec670db8ff0f',uuid=c107e5ac-af58-4702-aa62-253f3424c585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Converting VIF {"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.objects.instance [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'pci_devices' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:35 user nova-compute[82009]:   <uuid>c107e5ac-af58-4702-aa62-253f3424c585</uuid>
Apr 11 18:10:35 user nova-compute[82009]:   <name>instance-00000007</name>
Apr 11 18:10:35 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:35 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:35 user nova-compute[82009]:   <metadata>
Apr 11 18:10:35 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:35 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:35 user nova-compute[82009]:       <nova:name>tempest-TestVolumeSwap-server-410575530</nova:name>
Apr 11 18:10:35 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:35</nova:creationTime>
Apr 11 18:10:35 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:35 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:35 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:35 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:user uuid="a6d4a1de4c8e49a0a14eec670db8ff0f">tempest-TestVolumeSwap-1807194571-project-member</nova:user>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:project uuid="19acb9280d2f48b59ad7b2fde0e4efb3">tempest-TestVolumeSwap-1807194571</nova:project>
Apr 11 18:10:35 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:35 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:35 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:35 user nova-compute[82009]:         <nova:port uuid="c8a46ee6-74bb-42ed-a653-649dc130b0f3">
Apr 11 18:10:35 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:10:35 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:35 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:35 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:35 user nova-compute[82009]:   </metadata>
Apr 11 18:10:35 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:35 user nova-compute[82009]:     <system>
Apr 11 18:10:35 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:35 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:35 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:35 user nova-compute[82009]:       <entry name="serial">c107e5ac-af58-4702-aa62-253f3424c585</entry>
Apr 11 18:10:35 user nova-compute[82009]:       <entry name="uuid">c107e5ac-af58-4702-aa62-253f3424c585</entry>
Apr 11 18:10:35 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:35 user nova-compute[82009]:     </system>
Apr 11 18:10:35 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:35 user nova-compute[82009]:   <os>
Apr 11 18:10:35 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:35 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:35 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:35 user nova-compute[82009]:   </os>
Apr 11 18:10:35 user nova-compute[82009]:   <features>
Apr 11 18:10:35 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:35 user nova-compute[82009]:     <apic/>
Apr 11 18:10:35 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:35 user nova-compute[82009]:   </features>
Apr 11 18:10:35 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:35 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:35 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:35 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:35 user nova-compute[82009]:   </clock>
Apr 11 18:10:35 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:35 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:35 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:35 user nova-compute[82009]:   </cpu>
Apr 11 18:10:35 user nova-compute[82009]:   <devices>
Apr 11 18:10:35 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:35 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:35 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk"/>
Apr 11 18:10:35 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:35 user nova-compute[82009]:     </disk>
Apr 11 18:10:35 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:35 user nova-compute[82009]:       <mac address="fa:16:3e:5b:a7:91"/>
Apr 11 18:10:35 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:35 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:35 user nova-compute[82009]:       <target dev="tapc8a46ee6-74"/>
Apr 11 18:10:35 user nova-compute[82009]:     </interface>
Apr 11 18:10:35 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:35 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/console.log" append="off"/>
Apr 11 18:10:35 user nova-compute[82009]:     </serial>
Apr 11 18:10:35 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:35 user nova-compute[82009]:     <video>
Apr 11 18:10:35 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:35 user nova-compute[82009]:     </video>
Apr 11 18:10:35 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:35 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:35 user nova-compute[82009]:     </rng>
Apr 11 18:10:35 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:35 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:35 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:35 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:35 user nova-compute[82009]:   </devices>
Apr 11 18:10:35 user nova-compute[82009]: </domain>
Apr 11 18:10:35 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-410575530',display_name='tempest-TestVolumeSwap-server-410575530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-410575530',id=7,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItze44OHRrzTJBXg4OENnJbauHoiu2rr3GWBqGL/9xCDLTcFJAl0TKCQF1smiP/y4xObggC6qDCPDzTrqWWOTF3SJ0yaeDG4pl0IVe4P1xS4HSXTcR8yMA4STp3p767Q==',key_name='tempest-keypair-1379978453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19acb9280d2f48b59ad7b2fde0e4efb3',ramdisk_id='',reservation_id='r-3rnkqan0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1807194571',owner_user_name='tempest-TestVolumeSwap-1807194571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6d4a1de4c8e49a0a14eec670db8ff0f',uuid=c107e5ac-af58-4702-aa62-253f3424c585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Converting VIF {"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG os_vif [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8a46ee6-74, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8a46ee6-74, col_values=(('external_ids', {'iface-id': 'c8a46ee6-74bb-42ed-a653-649dc130b0f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:a7:91', 'vm-uuid': 'c107e5ac-af58-4702-aa62-253f3424c585'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:35 user nova-compute[82009]: INFO os_vif [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74')
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] No VIF found with MAC fa:16:3e:5b:a7:91, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Updating instance_info_cache with network_info: [{"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Releasing lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Instance network_info: |[{"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Start _get_guest_xml network_info=[{"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:10:17Z,direct_url=<?>,disk_format='qcow2',id=f23e66cf-31f3-42e5-a4a8-81cf2a978f9b,min_disk=0,min_ram=0,name='',owner='7bb8f230bf4b4022a83daf50d4d3e5b5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:10:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_name': '/dev/sda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_format': None, 'image_id': 'f23e66cf-31f3-42e5-a4a8-81cf2a978f9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:35 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:35 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:10:17Z,direct_url=<?>,disk_format='qcow2',id=f23e66cf-31f3-42e5-a4a8-81cf2a978f9b,min_disk=0,min_ram=0,name='',owner='7bb8f230bf4b4022a83daf50d4d3e5b5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:10:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:35 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1530757380',display_name='tempest-AttachSCSIVolumeTestJSON-server-1530757380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1530757380',id=8,image_ref='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0URwNWIYJkMnsH7m5y9Ix5AGr3fUW1mmaNHKkOgHReSsf7+ifIsMRKy3D+5OUYVR+uALgWoGRZVY/SK5EoQHgh4Tqa+XoLfK43xtpIx2sSmLqhVUgk3pmOtflWsIvJBw==',key_name='tempest-keypair-752484616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b181392922e741a784b8a0d59ca79f7f',ramdisk_id='',reservation_id='r-ovy1ftps',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1972641769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1972641769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b6375313b85465aa965faf4b75eec5c',uuid=67cf8e45-399b-4709-a994-15daf849132a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Converting VIF {"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'pci_devices' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:36 user nova-compute[82009]:   <uuid>67cf8e45-399b-4709-a994-15daf849132a</uuid>
Apr 11 18:10:36 user nova-compute[82009]:   <name>instance-00000008</name>
Apr 11 18:10:36 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:36 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:36 user nova-compute[82009]:   <metadata>
Apr 11 18:10:36 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:36 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:36 user nova-compute[82009]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1530757380</nova:name>
Apr 11 18:10:36 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:35</nova:creationTime>
Apr 11 18:10:36 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:36 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:36 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:36 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:user uuid="9b6375313b85465aa965faf4b75eec5c">tempest-AttachSCSIVolumeTestJSON-1972641769-project-member</nova:user>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:project uuid="b181392922e741a784b8a0d59ca79f7f">tempest-AttachSCSIVolumeTestJSON-1972641769</nova:project>
Apr 11 18:10:36 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:36 user nova-compute[82009]:       <nova:root type="image" uuid="f23e66cf-31f3-42e5-a4a8-81cf2a978f9b"/>
Apr 11 18:10:36 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:36 user nova-compute[82009]:         <nova:port uuid="83cfb5bf-92c3-4c75-b57f-0ad3382eb92a">
Apr 11 18:10:36 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 18:10:36 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:36 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:36 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:36 user nova-compute[82009]:   </metadata>
Apr 11 18:10:36 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:36 user nova-compute[82009]:     <system>
Apr 11 18:10:36 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:36 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:36 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:36 user nova-compute[82009]:       <entry name="serial">67cf8e45-399b-4709-a994-15daf849132a</entry>
Apr 11 18:10:36 user nova-compute[82009]:       <entry name="uuid">67cf8e45-399b-4709-a994-15daf849132a</entry>
Apr 11 18:10:36 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:36 user nova-compute[82009]:     </system>
Apr 11 18:10:36 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:36 user nova-compute[82009]:   <os>
Apr 11 18:10:36 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:36 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:36 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:36 user nova-compute[82009]:   </os>
Apr 11 18:10:36 user nova-compute[82009]:   <features>
Apr 11 18:10:36 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:36 user nova-compute[82009]:     <apic/>
Apr 11 18:10:36 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:36 user nova-compute[82009]:   </features>
Apr 11 18:10:36 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:36 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:36 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:36 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:36 user nova-compute[82009]:   </clock>
Apr 11 18:10:36 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:36 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:36 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:36 user nova-compute[82009]:   </cpu>
Apr 11 18:10:36 user nova-compute[82009]:   <devices>
Apr 11 18:10:36 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:36 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:36 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk"/>
Apr 11 18:10:36 user nova-compute[82009]:       <target dev="sda" bus="scsi"/>
Apr 11 18:10:36 user nova-compute[82009]:       <address type="drive" controller="0" unit="0"/>
Apr 11 18:10:36 user nova-compute[82009]:     </disk>
Apr 11 18:10:36 user nova-compute[82009]:     <disk type="file" device="cdrom">
Apr 11 18:10:36 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 18:10:36 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.config"/>
Apr 11 18:10:36 user nova-compute[82009]:       <target dev="sdb" bus="scsi"/>
Apr 11 18:10:36 user nova-compute[82009]:       <address type="drive" controller="0" unit="1"/>
Apr 11 18:10:36 user nova-compute[82009]:     </disk>
Apr 11 18:10:36 user nova-compute[82009]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 18:10:36 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:36 user nova-compute[82009]:       <mac address="fa:16:3e:6f:03:66"/>
Apr 11 18:10:36 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:36 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:36 user nova-compute[82009]:       <target dev="tap83cfb5bf-92"/>
Apr 11 18:10:36 user nova-compute[82009]:     </interface>
Apr 11 18:10:36 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:36 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/console.log" append="off"/>
Apr 11 18:10:36 user nova-compute[82009]:     </serial>
Apr 11 18:10:36 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:36 user nova-compute[82009]:     <video>
Apr 11 18:10:36 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:36 user nova-compute[82009]:     </video>
Apr 11 18:10:36 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:36 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:36 user nova-compute[82009]:     </rng>
Apr 11 18:10:36 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:36 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:36 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:36 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:36 user nova-compute[82009]:   </devices>
Apr 11 18:10:36 user nova-compute[82009]: </domain>
Apr 11 18:10:36 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1530757380',display_name='tempest-AttachSCSIVolumeTestJSON-server-1530757380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1530757380',id=8,image_ref='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0URwNWIYJkMnsH7m5y9Ix5AGr3fUW1mmaNHKkOgHReSsf7+ifIsMRKy3D+5OUYVR+uALgWoGRZVY/SK5EoQHgh4Tqa+XoLfK43xtpIx2sSmLqhVUgk3pmOtflWsIvJBw==',key_name='tempest-keypair-752484616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b181392922e741a784b8a0d59ca79f7f',ramdisk_id='',reservation_id='r-ovy1ftps',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1972641769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1972641769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b6375313b85465aa965faf4b75eec5c',uuid=67cf8e45-399b-4709-a994-15daf849132a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Converting VIF {"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG os_vif [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83cfb5bf-92, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83cfb5bf-92, col_values=(('external_ids', {'iface-id': '83cfb5bf-92c3-4c75-b57f-0ad3382eb92a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:03:66', 'vm-uuid': '67cf8e45-399b-4709-a994-15daf849132a'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:36 user nova-compute[82009]: INFO os_vif [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92')
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.network.neutron [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updated VIF entry in instance network info cache for port c8a46ee6-74bb-42ed-a653-649dc130b0f3. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.network.neutron [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updating instance_info_cache with network_info: [{"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No BDM found with device name sda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No VIF found with MAC fa:16:3e:6f:03:66, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:36 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Using config drive
Apr 11 18:10:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95b228c9-cb13-4c51-9d60-963983277b2b req-985af11b-37c7-4407-a6ae-6dd8272005a1 service nova] Releasing lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:36 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Creating config drive at /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.config
Apr 11 18:10:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzeoyjql6 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzeoyjql6" returned: 0 in 0.083s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] No waiting events found dispatching network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:37 user nova-compute[82009]: WARNING nova.compute.manager [req-151c0b7e-f9f8-47e9-a803-263934951bfb req-afd7277f-b3e3-4c04-8ed3-15fe36be2ccc service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received unexpected event network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance with vm_state building and task_state spawning.
Apr 11 18:10:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] No waiting events found dispatching network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:39 user nova-compute[82009]: WARNING nova.compute.manager [req-f4507824-90ac-473a-ae78-d99e3bab46d3 req-1bd3eaa9-6b03-48c9-ab51-e4679f46a844 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received unexpected event network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance with vm_state building and task_state spawning.
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:39 user nova-compute[82009]: INFO nova.compute.claims [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Claim successful on node user
Apr 11 18:10:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] No waiting events found dispatching network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:39 user nova-compute[82009]: WARNING nova.compute.manager [req-a2739bbb-073b-4951-aa50-8ef3eeb495ba req-34f1de17-2bcf-48c3-ace4-cd010037dbd0 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received unexpected event network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance with vm_state building and task_state spawning.
Apr 11 18:10:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.policy [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:10:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Creating image(s)
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.109s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.198s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk 1073741824" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.172s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236641.2565703, c107e5ac-af58-4702-aa62-253f3424c585 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] VM Resumed (Lifecycle Event)
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Instance spawned successfully.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236641.2623537, c107e5ac-af58-4702-aa62-253f3424c585 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] VM Started (Lifecycle Event)
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Cannot resize image /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'migration_context' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] No waiting events found dispatching network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:41 user nova-compute[82009]: WARNING nova.compute.manager [req-5cc5a9f5-3b19-4b46-b9f6-4fbd48549032 req-6cb6c6e7-bc40-4913-ad27-e6624b275f1c service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received unexpected event network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance with vm_state building and task_state spawning.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Ensure instance console log exists: /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Took 11.45 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Took 13.07 seconds to build instance.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-48626e5a-d9a1-4f87-a932-2b392d6a413c tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.238s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236641.7309384, 67cf8e45-399b-4709-a994-15daf849132a => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] VM Resumed (Lifecycle Event)
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Instance spawned successfully.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236641.739315, 67cf8e45-399b-4709-a994-15daf849132a => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] VM Started (Lifecycle Event)
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Took 10.35 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:41 user nova-compute[82009]: INFO nova.compute.manager [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Took 13.26 seconds to build instance.
Apr 11 18:10:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd0a2065-7ac7-48e6-a77d-541aeb77b600 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.447s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:42 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Successfully created port: 8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Successfully updated port: 8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquired lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-changed-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Refreshing instance network info cache due to event network-changed-8967a8d4-b607-4572-bfc2-50c7663563cb. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Acquiring lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Releasing lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Instance network_info: |[{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Acquired lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.neutron [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Refreshing network info cache for port 8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Start _get_guest_xml network_info=[{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:10:43 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:43 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:10:43 user nova-compute[82009]:   <uuid>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</uuid>
Apr 11 18:10:43 user nova-compute[82009]:   <name>instance-00000009</name>
Apr 11 18:10:43 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:10:43 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:10:43 user nova-compute[82009]:   <metadata>
Apr 11 18:10:43 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:10:43 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:10:43 user nova-compute[82009]:       <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:10:43 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:10:43</nova:creationTime>
Apr 11 18:10:43 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:10:43 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:10:43 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:10:43 user nova-compute[82009]:       <nova:owner>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:10:43 user nova-compute[82009]:       </nova:owner>
Apr 11 18:10:43 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:10:43 user nova-compute[82009]:       <nova:ports>
Apr 11 18:10:43 user nova-compute[82009]:         <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:10:43 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:10:43 user nova-compute[82009]:         </nova:port>
Apr 11 18:10:43 user nova-compute[82009]:       </nova:ports>
Apr 11 18:10:43 user nova-compute[82009]:     </nova:instance>
Apr 11 18:10:43 user nova-compute[82009]:   </metadata>
Apr 11 18:10:43 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:10:43 user nova-compute[82009]:     <system>
Apr 11 18:10:43 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:10:43 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:10:43 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:10:43 user nova-compute[82009]:       <entry name="serial">9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:10:43 user nova-compute[82009]:       <entry name="uuid">9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:10:43 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:10:43 user nova-compute[82009]:     </system>
Apr 11 18:10:43 user nova-compute[82009]:   </sysinfo>
Apr 11 18:10:43 user nova-compute[82009]:   <os>
Apr 11 18:10:43 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:10:43 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:10:43 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:10:43 user nova-compute[82009]:   </os>
Apr 11 18:10:43 user nova-compute[82009]:   <features>
Apr 11 18:10:43 user nova-compute[82009]:     <acpi/>
Apr 11 18:10:43 user nova-compute[82009]:     <apic/>
Apr 11 18:10:43 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:10:43 user nova-compute[82009]:   </features>
Apr 11 18:10:43 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:10:43 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:10:43 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:10:43 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:10:43 user nova-compute[82009]:   </clock>
Apr 11 18:10:43 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:10:43 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:10:43 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:10:43 user nova-compute[82009]:   </cpu>
Apr 11 18:10:43 user nova-compute[82009]:   <devices>
Apr 11 18:10:43 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:10:43 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:10:43 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk"/>
Apr 11 18:10:43 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:10:43 user nova-compute[82009]:     </disk>
Apr 11 18:10:43 user nova-compute[82009]:     <disk type="file" device="cdrom">
Apr 11 18:10:43 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 18:10:43 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config"/>
Apr 11 18:10:43 user nova-compute[82009]:       <target dev="hda" bus="ide"/>
Apr 11 18:10:43 user nova-compute[82009]:     </disk>
Apr 11 18:10:43 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:10:43 user nova-compute[82009]:       <mac address="fa:16:3e:b3:20:c6"/>
Apr 11 18:10:43 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:43 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:10:43 user nova-compute[82009]:       <target dev="tap8967a8d4-b6"/>
Apr 11 18:10:43 user nova-compute[82009]:     </interface>
Apr 11 18:10:43 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:10:43 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log" append="off"/>
Apr 11 18:10:43 user nova-compute[82009]:     </serial>
Apr 11 18:10:43 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:10:43 user nova-compute[82009]:     <video>
Apr 11 18:10:43 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:10:43 user nova-compute[82009]:     </video>
Apr 11 18:10:43 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:10:43 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:10:43 user nova-compute[82009]:     </rng>
Apr 11 18:10:43 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:10:43 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:10:43 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:10:43 user nova-compute[82009]:     </memballoon>
Apr 11 18:10:43 user nova-compute[82009]:   </devices>
Apr 11 18:10:43 user nova-compute[82009]: </domain>
Apr 11 18:10:43 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG os_vif [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8967a8d4-b6, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8967a8d4-b6, col_values=(('external_ids', {'iface-id': '8967a8d4-b607-4572-bfc2-50c7663563cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:20:c6', 'vm-uuid': '9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:43 user nova-compute[82009]: INFO os_vif [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6')
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No BDM found with device name hda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:10:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No VIF found with MAC fa:16:3e:b3:20:c6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:10:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Using config drive
Apr 11 18:10:44 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Creating config drive at /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config
Apr 11 18:10:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphn96jqj9 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphn96jqj9" returned: 0 in 0.070s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:44 user nova-compute[82009]: DEBUG nova.network.neutron [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updated VIF entry in instance network info cache for port 8967a8d4-b607-4572-bfc2-50c7663563cb. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:10:44 user nova-compute[82009]: DEBUG nova.network.neutron [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-92da8331-a998-4112-bf7b-1e284e47ec41 req-e92e6297-f4d7-42e5-abcf-5b926887e7d3 service nova] Releasing lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:46 user nova-compute[82009]: WARNING nova.compute.manager [req-31ae5745-5321-4ae3-8d69-20ace0760488 req-1678c802-9498-428a-b4c6-68f01852a686 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb for instance with vm_state building and task_state spawning.
Apr 11 18:10:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:10:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236648.2498941, 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] VM Resumed (Lifecycle Event)
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Instance spawned successfully.
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236648.2515736, 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] VM Started (Lifecycle Event)
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Took 7.94 seconds to spawn the instance on the hypervisor.
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:10:48 user nova-compute[82009]: INFO nova.compute.manager [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Took 9.11 seconds to build instance.
Apr 11 18:10:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4e11d82-537e-4687-a2d3-e719c85c2dfc tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.343s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:10:48 user nova-compute[82009]: WARNING nova.compute.manager [req-cc24e929-5972-4266-b154-aeeef0acdd73 req-6e7a8ea4-d940-43e5-9fd4-31e82d486702 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb for instance with vm_state active and task_state None.
Apr 11 18:10:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:10:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:10:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:10:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:10:49 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:10:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:53 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:53 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:10:53 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7627MB free_disk=26.758853912353516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c107e5ac-af58-4702-aa62-253f3424c585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 67cf8e45-399b-4709-a994-15daf849132a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance ce16e1aa-f16b-40be-945a-78265fb23638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:10:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:10:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:10:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:57 user nova-compute[82009]: INFO nova.compute.claims [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Claim successful on node user
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.562s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:10:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:10:57 user nova-compute[82009]: INFO nova.compute.claims [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Claim successful on node user
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:58 user nova-compute[82009]: INFO nova.virt.block_device [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Booting with volume ffe808d1-d7d3-4c81-b366-1b777fac9dee at /dev/vda
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.policy [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c63dc594a1a4977b67ccc1a63d09de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e235e9f2e72e4fc28995bf9716d8e4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG os_brick.utils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:10:58 user nova-compute[82009]: INFO oslo.privsep.daemon [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpe2bf9pkj/privsep.sock']
Apr 11 18:10:58 user sudo[92245]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpe2bf9pkj/privsep.sock
Apr 11 18:10:58 user sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:10:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:10:58 user nova-compute[82009]: INFO nova.virt.block_device [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Booting with volume f02bca93-4b17-45a3-bf13-273b5d34dc02 at /dev/vda
Apr 11 18:10:58 user nova-compute[82009]: DEBUG os_brick.utils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG nova.policy [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59738138e8c346a393ea13fe7fadbe88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '661f042c46b14d2184cfaa77200899a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:10:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:10:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully created port: ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully created port: 8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully created port: cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:10:59 user sudo[92245]: pam_unix(sudo:session): session closed for user root
Apr 11 18:10:59 user nova-compute[82009]: INFO oslo.privsep.daemon [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Spawned new privsep daemon via rootwrap
Apr 11 18:10:59 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 18:10:59 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 18:10:59 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 18:10:59 user nova-compute[82009]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92248
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcc33dc-1d6e-4f9a-b310-ca0cc97dd231]: (2,) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: WARNING oslo_privsep.priv_context [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] privsep daemon already running
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68604f4-1f11-4761-a43b-7513e4c56336]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: WARNING os_brick.initiator.connectors.nvmeof [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcad648-9dff-44a4-9b0d-35f28fc572f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fad26-7cc7-4122-b573-02d7b4661fb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828f729-c2e2-4d63-807a-1ad446a259a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully created port: 7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d107853b-a173-407c-a8b7-7c77cdbf1839]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd7c073-f922-49b0-8c03-3db3382b2ba0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[312631e9-4956-4c36-ae47-ef7680942ff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[64713560-7e5d-4be9-b975-1fa231b7ad32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:00 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3511caa-3d35-4e02-ac33-2f3cfbed8230]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:00 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:11:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[768fbc7e-b4c5-4230-bef5-bc4b2f7bce7c]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.utils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== get_connector_properties: return (1560ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating existing volume attachment record: 228bf3c5-4d49-47b6-b6f9-52d674b54b06 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG os_brick.utils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== get_connector_properties: return (2068ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating existing volume attachment record: d5cf5e83-1cf0-42be-ba84-251555cc788e {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully created port: eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully created port: 9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully created port: 5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully created port: 11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:02 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully created port: ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:02 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully created port: 9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-ced10f2e-f2b3-49c0-9232-989b3cc110e0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: 218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7afc5181-f207-4afe-8bca-7fa4b73d02d9 req-895a1b27-e53e-4951-8a92-6c31b6f91ad0 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: 8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-8e9ebc37-3669-4688-97c5-f3ff04bc51e3. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: 9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-62e78adc-1d14-482c-9a38-14a53c6b6bd7 req-b42e8cbe-b78a-4520-af35-8957b50f7699 service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:04 user nova-compute[82009]: INFO nova.virt.block_device [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Booting with volume 2f7af65f-1aed-4e9e-b945-688f1ab39728 at /dev/vdb
Apr 11 18:11:04 user nova-compute[82009]: INFO nova.virt.block_device [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Booting with volume a4caf909-3c23-44c2-a1c4-72152f20bb4e at /dev/vdb
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.utils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.utils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6866cd14-63ab-4de3-8e48-bd65c2a4d886]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f445c3-dc40-4516-8946-4153cc6747f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[908abcc0-25ac-44fc-aaed-b113222d3fde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a28d00-4487-480d-ae0e-c9e167567a58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f4c77-39ca-43f7-87df-9dd71214283a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62680df-5535-400c-b8d0-7c3b66030dcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23da461-ab5d-4d9f-851d-697d06decbeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4318e-578d-4add-9a86-5389b57b583c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:05 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb910c7b-71d0-44d4-9377-8634f8949e1f]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.utils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating existing volume attachment record: 9f798562-612f-48c6-baf4-81bc6141d6c2 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:05 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848280b-1bf9-4fc8-804d-72be405ceacc]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG os_brick.utils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating existing volume attachment record: 3df694d4-e149-4001-921f-c2e70bd7c9b3 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: 903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-218012bb-cbbd-412d-85af-8c76ac2c273d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.network.neutron [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port 218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.network.neutron [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port 9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-903ba719-5693-44ed-985d-74770767b6c5. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e073b951-eccd-43ac-94dc-61205a5fa0be req-a8208fc5-7b14-4944-8b45-49fb7f557a05 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-437b5554-1990-471f-b83e-9cdc70a35b38 req-f3429a29-9b81-4528-9891-21600bd373da service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: 7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-cec9b7a9-6277-4820-8c0b-0fb252127d98. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: 5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-85ad5db4-0486-4168-afd0-95764ddfd685 req-94acfcb5-305c-44c5-8a6f-f8f50a4856d0 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-7abbaabc-4691-4bea-975e-632d04d0983d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: 9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc8edb6b-de05-4a0d-8e1c-ad7a93d50aaf req-b1397a3d-f33f-495b-b78d-e2fbd916ef56 service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port 5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:09 user nova-compute[82009]: INFO nova.virt.block_device [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Booting with volume da10aa27-09c0-4428-b528-8c5555a12970 at /dev/vdc
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb5228-87fe-4d87-9cf2-04fc0ec3c55c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c3a79-cd88-4195-a6e8-f9a2ee18131d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d309f6f9-9c75-47ae-9e80-e2a7c6f79f4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b0a02-9ae9-472b-9726-d4c35c1fca80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:11:09 user nova-compute[82009]: INFO nova.virt.block_device [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Booting with volume 858c22bc-7928-4813-9303-f52929365664 at /dev/vdc
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:09 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49ce83-07c8-40da-8061-dfec28fa3b94]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating existing volume attachment record: eb305a8d-883a-442a-a302-8028713fdb85 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfd1f83-befd-437d-b7ca-73241af9a473]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4406299-f7a9-41f3-bfb9-7f37ff12f0c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b8cfb-d613-4786-a0d8-488f7dbda357]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b10dd04-eb20-4f4e-a41b-b04422dc39f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:11:09 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:11:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936beb1-41ee-4aea-bf15-eb038ebffafc]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:09 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating existing volume attachment record: 46d9f6ea-4e01-438f-ba26-57e6c3d5a5ab {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Successfully updated port: ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0821b6d-141b-43d4-aeb3-db5b42574cde req-5da44b7e-d7d8-45c2-b503-004c1f32a38e service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: 11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG nova.network.neutron [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-566b2411-9488-4c1e-9501-bcebb366623d req-bb3b654c-35d1-4e67-af11-2cd6ba1d45de service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Successfully updated port: 9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:11:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-11876d87-cfbc-4d1e-84aa-62d927337a20. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance network_info: |[{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updated VIF entry in instance network info cache for port ccbdc6f5-6226-4b61-8ec9-45e77798e8aa. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb5ba16-b6ed-40cc-a477-9780ce6d5cca req-031a82a9-b1da-4f26-a5dc-3c8b338f0062 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance network_info: |[{"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:11:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Creating image(s)
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Ensure instance console log exists: /opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Start _get_guest_xml network_info=[{"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '228bf3c5-4d49-47b6-b6f9-52d674b54b06', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTOsHFro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3aedb5f4-32cf-497c-8035-0f694cbf78cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'f02bca93-4b17-45a3-bf13-273b5d34dc02', 'serial': 'f02bca93-4b17-45a3-bf13-273b5d34dc02'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '3df694d4-e149-4001-921f-c2e70bd7c9b3', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuYLSHbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3aedb5f4-32cf-497c-8035-0f694cbf78cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4caf909-3c23-44c2-a1c4-72152f20bb4e', 'serial': 'a4caf909-3c23-44c2-a1c4-72152f20bb4e'}, 'boot_index': 1, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'eb305a8d-883a-442a-a302-8028713fdb85', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChxMzgmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3aedb5f4-32cf-497c-8035-0f694cbf78cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'da10aa27-09c0-4428-b528-8c5555a12970', 'serial': 'da10aa27-09c0-4428-b528-8c5555a12970'}, 'boot_index': 2, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:11:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connector [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Factory for ISCSI on None {{(pid=82009) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTOsHFro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:14 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:14 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:14 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba213ba-21df-40fb-83ef-99ba7afda447]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:11:14 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48fe6e1-aa38-4dd5-8120-cdffa56cf735]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02] added
Apr 11 18:11:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e85d6d-2b5f-4bfe-8df5-800a3678a407]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d637d03-4904-4384-a6d8-ccb3f0610c92]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTOsHFro {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTOsHFro" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d8694-d2f3-4816-9f19-1de15ab92c2d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTOsHFro'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b5025-264c-4287-9e01-4f27d8eede2c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5b28b8-9774-4e67-81fa-5e4bf086585d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:11:14 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:11:14 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:14 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:11:14 user nova-compute[82009]: 
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updated VIF entry in instance network info cache for port 11876d87-cfbc-4d1e-84aa-62d927337a20. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:11:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Creating image(s)
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Ensure instance console log exists: /opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Start _get_guest_xml network_info=[{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd5cf5e83-1cf0-42be-ba84-251555cc788e', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoASLztv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd86b2f4-002e-48ab-987c-b081681b5e07', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffe808d1-d7d3-4c81-b366-1b777fac9dee', 'serial': 'ffe808d1-d7d3-4c81-b366-1b777fac9dee'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '9f798562-612f-48c6-baf4-81bc6141d6c2', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyDMlvqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd86b2f4-002e-48ab-987c-b081681b5e07', 'attached_at': '', 'detached_at': '', 'volume_id': '2f7af65f-1aed-4e9e-b945-688f1ab39728', 'serial': '2f7af65f-1aed-4e9e-b945-688f1ab39728'}, 'boot_index': 1, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '46d9f6ea-4e01-438f-ba26-57e6c3d5a5ab', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUzNFoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd86b2f4-002e-48ab-987c-b081681b5e07', 'attached_at': '', 'detached_at': '', 'volume_id': '858c22bc-7928-4813-9303-f52929365664', 'serial': '858c22bc-7928-4813-9303-f52929365664'}, 'boot_index': 2, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f3b244-e89a-4ccc-88d2-9b9e3c63c0b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260]
Apr 11 18:11:14 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260] successful.
Apr 11 18:11:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoASLztv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:14 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d307cf-0bc0-4f3e-b564-3fe61b1d4d7f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad46a14-9f02-4f2a-8a04-139144b5a2d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d476197-67dd-4e29-8b0c-5534b6152e0f]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:11:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTOsHFro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updated VIF entry in instance network info cache for port 9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acc017ee-2c6c-4226-8828-709189556db6 req-a2ebe6bd-63c5-46d6-815d-a9287a47ff8e service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23737343132333966', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737343132333966', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.072s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:15 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:15 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf6ad70-e756-4196-92a4-adabdc4a0aca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:11:15 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuYLSHbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:15 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a5b892-01b5-427f-b9ea-d3eed881fef2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee] added
Apr 11 18:11:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b69f0db-3abb-4bd7-ab1f-b004a31f6ae6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b4fe5f-40d9-49dc-9f48-d447cba6ecc1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoASLztv {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HoASLztv" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7079078-1724-4a0a-8e8a-b0c7e915a53e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HoASLztv'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc1d3c-e341-4d44-94c6-94481d44a44d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0751ff-4ea7-4007-ba65-ea01bbe08f91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[719da406-3705-4e06-b6ea-8bd0f85bb3e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260]
Apr 11 18:11:15 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260] successful.
Apr 11 18:11:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[808c99ca-f52e-4495-b11f-8ef44eb9a5ec]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[34326f62-0357-40fd-bf26-9cd1b560337c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:16 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:16 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeab714-e6c5-4793-aa53-fbaad2e6f666]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoASLztv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:11:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== connect_volume: return (2384ms) {'type': 'block', 'scsi_wwn': '23033393437636566', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033393437636566', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.286s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:17 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:17 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b6046c-9c07-4d53-b401-1ccea88068c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:11:17 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyDMlvqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:17 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3171173-6f31-41ea-9176-e13e12a406d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e] added
Apr 11 18:11:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec28f8-9b79-4515-a190-9567c1683c55]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d457569-1bf5-49d3-b8f1-889caab21c83]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuYLSHbz {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuYLSHbz" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e70d5-3b37-421d-8f78-915262b130a6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuYLSHbz'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81ca320-722a-49c0-8bf5-ff3434784a5b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf136702-32c0-44fd-913b-2b5334e5dd23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:17 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:17 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c8e7e-d2f1-48a2-9762-d624bf049801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260]
Apr 11 18:11:17 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260] successful.
Apr 11 18:11:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f80b04d-390c-4c11-a8d9-bf28e98588e7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e7dc7b-1f0e-4c69-9fd8-ff086e29a794]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:17 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:17 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:17 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:17 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[48868bed-2e16-4bd7-a274-f19d0dff7b2c]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:11:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuYLSHbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== connect_volume: return (2616ms) {'type': 'block', 'scsi_wwn': '23130356138323666', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356138323666', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:18 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:18 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a8a25-7f3d-4e8c-84c7-23e3209687e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:11:18 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChxMzgmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:18 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc08bfd-a1e7-4808-851f-60530b18a37c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728] added
Apr 11 18:11:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9bedb-b3bd-4b6d-a22f-9520c1aa68a2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72badd93-a358-46c9-bd6f-f11315c39128]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyDMlvqX {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyDMlvqX" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1618caa-f046-40d3-95b9-34fa0b5917e5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyDMlvqX'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d3fd65-f91b-4d5e-bf43-ed8dcd7b36ae]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1f3fe-3df2-4897-8816-411b72947afb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c037e-ddeb-4e94-b5a9-aeee00f43d9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260]
Apr 11 18:11:18 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260] successful.
Apr 11 18:11:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5659d781-9498-4e45-80cc-2bb63c70a879]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5d13e-cef2-43ea-a35d-27810e2a7ceb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:18 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eac22a-b6e2-4751-8668-4042942108d2]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyDMlvqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:11:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== connect_volume: return (2615ms) {'type': 'block', 'scsi_wwn': '23736326533363834', 'path': '/dev/sde'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736326533363834', 'path': '/dev/sde'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:19 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:19 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf3e29-1b06-49cb-b3bf-14fbfa0c6153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:11:19 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUzNFoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:11:19 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[77da3095-c170-4068-91a8-4448efd9a8e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970] added
Apr 11 18:11:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8ce27-e3d7-46ce-b469-69bc0b6fe060]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e777d62e-82fb-4e2e-a00b-9278b4802788]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChxMzgmP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChxMzgmP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857f091-caa5-4b0e-83a1-841c7e4e4020]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChxMzgmP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f80aaf4-93bd-49ab-8342-a03feea73455]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e43252-f20c-49f9-a46a-379a5c783008]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:19 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:19 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:19 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:19 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:19 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:19 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77b6bb7-61b2-4c33-b34f-12ffd66a83c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260]
Apr 11 18:11:19 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260] successful.
Apr 11 18:11:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.081s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f72f59-7805-4334-b74e-a5d6d0b36920]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7680d0c0-27cb-4dad-b576-6e19dcfcd7ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:11:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:20 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:11:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8721fc7c-6775-4fe5-b87c-4091f6c29af3]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:11:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChxMzgmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== connect_volume: return (2685ms) {'type': 'block', 'scsi_wwn': '23130373261653466', 'path': '/dev/sdf'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130373261653466', 'path': '/dev/sdf'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.364s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:21 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3805938a-fccd-4f88-8961-7eae46833d29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:11:21 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aedb5f4-32cf-497c-8035-0f694cbf78cf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd2c701-a4ae-4fd0-abfe-e944f59ae23c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664] added
Apr 11 18:11:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:11:21 user nova-compute[82009]:   <uuid>3aedb5f4-32cf-497c-8035-0f694cbf78cf</uuid>
Apr 11 18:11:21 user nova-compute[82009]:   <name>instance-0000000b</name>
Apr 11 18:11:21 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:11:21 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:11:21 user nova-compute[82009]:   <metadata>
Apr 11 18:11:21 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:11:21 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:11:21 user nova-compute[82009]:       <nova:name>tempest-device-tagging-server-490010717</nova:name>
Apr 11 18:11:21 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:11:14</nova:creationTime>
Apr 11 18:11:21 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:11:21 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:11:21 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:11:21 user nova-compute[82009]:       <nova:owner>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:user uuid="59738138e8c346a393ea13fe7fadbe88">tempest-TaggedBootDevicesTest-479213965-project-member</nova:user>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:project uuid="661f042c46b14d2184cfaa77200899a8">tempest-TaggedBootDevicesTest-479213965</nova:project>
Apr 11 18:11:21 user nova-compute[82009]:       </nova:owner>
Apr 11 18:11:21 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:11:21 user nova-compute[82009]:       <nova:ports>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="8e9ebc37-3669-4688-97c5-f3ff04bc51e3">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="903ba719-5693-44ed-985d-74770767b6c5">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="cec9b7a9-6277-4820-8c0b-0fb252127d98">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="7abbaabc-4691-4bea-975e-632d04d0983d">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="9a7ffc75-0c3a-4516-a414-bb6e41a59c1d">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="11876d87-cfbc-4d1e-84aa-62d927337a20">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:         <nova:port uuid="9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a">
Apr 11 18:11:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 18:11:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:21 user nova-compute[82009]:       </nova:ports>
Apr 11 18:11:21 user nova-compute[82009]:     </nova:instance>
Apr 11 18:11:21 user nova-compute[82009]:   </metadata>
Apr 11 18:11:21 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:11:21 user nova-compute[82009]:     <system>
Apr 11 18:11:21 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:11:21 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:11:21 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:11:21 user nova-compute[82009]:       <entry name="serial">3aedb5f4-32cf-497c-8035-0f694cbf78cf</entry>
Apr 11 18:11:21 user nova-compute[82009]:       <entry name="uuid">3aedb5f4-32cf-497c-8035-0f694cbf78cf</entry>
Apr 11 18:11:21 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:11:21 user nova-compute[82009]:     </system>
Apr 11 18:11:21 user nova-compute[82009]:   </sysinfo>
Apr 11 18:11:21 user nova-compute[82009]:   <os>
Apr 11 18:11:21 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:11:21 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:11:21 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:11:21 user nova-compute[82009]:   </os>
Apr 11 18:11:21 user nova-compute[82009]:   <features>
Apr 11 18:11:21 user nova-compute[82009]:     <acpi/>
Apr 11 18:11:21 user nova-compute[82009]:     <apic/>
Apr 11 18:11:21 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:11:21 user nova-compute[82009]:   </features>
Apr 11 18:11:21 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:11:21 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:11:21 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:11:21 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:11:21 user nova-compute[82009]:   </clock>
Apr 11 18:11:21 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:11:21 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:11:21 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:11:21 user nova-compute[82009]:   </cpu>
Apr 11 18:11:21 user nova-compute[82009]:   <devices>
Apr 11 18:11:21 user nova-compute[82009]:     <disk type="file" device="cdrom">
Apr 11 18:11:21 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 18:11:21 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf/disk.config"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="hda" bus="ide"/>
Apr 11 18:11:21 user nova-compute[82009]:     </disk>
Apr 11 18:11:21 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:11:21 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:11:21 user nova-compute[82009]:       <source dev="/dev/sdb"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <serial>f02bca93-4b17-45a3-bf13-273b5d34dc02</serial>
Apr 11 18:11:21 user nova-compute[82009]:     </disk>
Apr 11 18:11:21 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:11:21 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:11:21 user nova-compute[82009]:       <source dev="/dev/sdd"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <serial>a4caf909-3c23-44c2-a1c4-72152f20bb4e</serial>
Apr 11 18:11:21 user nova-compute[82009]:     </disk>
Apr 11 18:11:21 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:11:21 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:11:21 user nova-compute[82009]:       <source dev="/dev/sdf"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="vdc" bus="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <serial>da10aa27-09c0-4428-b528-8c5555a12970</serial>
Apr 11 18:11:21 user nova-compute[82009]:     </disk>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:1b:21:79"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tap8e9ebc37-36"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:02:c6:90"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tap903ba719-56"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:17:60:f8"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tapcec9b7a9-62"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:46:62:81"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tap7abbaabc-46"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:b4:80:41"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tap9a7ffc75-0c"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:93:83:3b"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tap11876d87-cf"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:21 user nova-compute[82009]:       <mac address="fa:16:3e:93:63:a9"/>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:21 user nova-compute[82009]:       <target dev="tap9c1b4ee0-c7"/>
Apr 11 18:11:21 user nova-compute[82009]:     </interface>
Apr 11 18:11:21 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:11:21 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf/console.log" append="off"/>
Apr 11 18:11:21 user nova-compute[82009]:     </serial>
Apr 11 18:11:21 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:11:21 user nova-compute[82009]:     <video>
Apr 11 18:11:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:21 user nova-compute[82009]:     </video>
Apr 11 18:11:21 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:11:21 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:11:21 user nova-compute[82009]:     </rng>
Apr 11 18:11:21 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:11:21 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:11:21 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:11:21 user nova-compute[82009]:     </memballoon>
Apr 11 18:11:21 user nova-compute[82009]:   </devices>
Apr 11 18:11:21 user nova-compute[82009]: </domain>
Apr 11 18:11:21 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8d5541-d0d8-4bd2-9a4e-193b1b1d3317]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e9ebc37-36, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e9ebc37-36, col_values=(('external_ids', {'iface-id': '8e9ebc37-3669-4688-97c5-f3ff04bc51e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:21:79', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b083c6-674c-4804-ae38-e92763fddd3f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUzNFoiQ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903ba719-56, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap903ba719-56, col_values=(('external_ids', {'iface-id': '903ba719-5693-44ed-985d-74770767b6c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:c6:90', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUzNFoiQ" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185588b-7491-4525-8321-6b17eab00470]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUzNFoiQ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcec9b7a9-62, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcec9b7a9-62, col_values=(('external_ids', {'iface-id': 'cec9b7a9-6277-4820-8c0b-0fb252127d98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:60:f8', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a544a-a3c6-4914-b1cf-c78fedeb2d20]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5962abf-facf-4441-8fbc-27ee70bd8eea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7abbaabc-46, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7abbaabc-46, col_values=(('external_ids', {'iface-id': '7abbaabc-4691-4bea-975e-632d04d0983d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:62:81', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a7ffc75-0c, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a7ffc75-0c, col_values=(('external_ids', {'iface-id': '9a7ffc75-0c3a-4516-a414-bb6e41a59c1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:80:41', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b95eb-56f0-4b98-b8f6-f76c4a8ae635]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260]
Apr 11 18:11:21 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260] successful.
Apr 11 18:11:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac4699-84c3-4c7d-8ebe-53e987fdd2d7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11876d87-cf, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11876d87-cf, col_values=(('external_ids', {'iface-id': '11876d87-cfbc-4d1e-84aa-62d927337a20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:83:3b', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0986b0-9d3e-4a18-b18d-de3b372d1b84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:11:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[806444b4-7636-4d6a-b88d-171daf25efbe]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUzNFoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1b4ee0-c7, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c1b4ee0-c7, col_values=(('external_ids', {'iface-id': '9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:63:a9', 'vm-uuid': '3aedb5f4-32cf-497c-8035-0f694cbf78cf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:21 user nova-compute[82009]: INFO os_vif [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7')
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] No BDM found with device name hda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] No VIF found with MAC fa:16:3e:1b:21:79, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] No VIF found with MAC fa:16:3e:b4:80:41, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:11:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Using config drive
Apr 11 18:11:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Creating config drive at /opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf/disk.config
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4wrselp8 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4wrselp8" returned: 0 in 0.075s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:11:22 user nova-compute[82009]: INFO nova.compute.claims [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Claim successful on node user
Apr 11 18:11:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== connect_volume: return (2744ms) {'type': 'block', 'scsi_wwn': '23831306662363833', 'path': '/dev/sdg'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831306662363833', 'path': '/dev/sdg'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lazy-loading 'pci_devices' on Instance uuid cd86b2f4-002e-48ab-987c-b081681b5e07 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:11:22 user nova-compute[82009]:   <uuid>cd86b2f4-002e-48ab-987c-b081681b5e07</uuid>
Apr 11 18:11:22 user nova-compute[82009]:   <name>instance-0000000a</name>
Apr 11 18:11:22 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:11:22 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:11:22 user nova-compute[82009]:   <metadata>
Apr 11 18:11:22 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:11:22 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:11:22 user nova-compute[82009]:       <nova:name>tempest-device-tagging-server-570145889</nova:name>
Apr 11 18:11:22 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:11:14</nova:creationTime>
Apr 11 18:11:22 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:11:22 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:11:22 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:11:22 user nova-compute[82009]:       <nova:owner>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:user uuid="7c63dc594a1a4977b67ccc1a63d09de4">tempest-TaggedBootDevicesTest_v242-1474407458-project-member</nova:user>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:project uuid="e235e9f2e72e4fc28995bf9716d8e4ff">tempest-TaggedBootDevicesTest_v242-1474407458</nova:project>
Apr 11 18:11:22 user nova-compute[82009]:       </nova:owner>
Apr 11 18:11:22 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:11:22 user nova-compute[82009]:       <nova:ports>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="ced10f2e-f2b3-49c0-9232-989b3cc110e0">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="218012bb-cbbd-412d-85af-8c76ac2c273d">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="cd517f24-d0a3-4a63-ad6d-9a2271f6d04e">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.254" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="eb5ef9e9-efcf-479d-8113-f6c3d284bfaa">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:         <nova:port uuid="ccbdc6f5-6226-4b61-8ec9-45e77798e8aa">
Apr 11 18:11:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 18:11:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:22 user nova-compute[82009]:       </nova:ports>
Apr 11 18:11:22 user nova-compute[82009]:     </nova:instance>
Apr 11 18:11:22 user nova-compute[82009]:   </metadata>
Apr 11 18:11:22 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:11:22 user nova-compute[82009]:     <system>
Apr 11 18:11:22 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:11:22 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:11:22 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:11:22 user nova-compute[82009]:       <entry name="serial">cd86b2f4-002e-48ab-987c-b081681b5e07</entry>
Apr 11 18:11:22 user nova-compute[82009]:       <entry name="uuid">cd86b2f4-002e-48ab-987c-b081681b5e07</entry>
Apr 11 18:11:22 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:11:22 user nova-compute[82009]:     </system>
Apr 11 18:11:22 user nova-compute[82009]:   </sysinfo>
Apr 11 18:11:22 user nova-compute[82009]:   <os>
Apr 11 18:11:22 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:11:22 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:11:22 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:11:22 user nova-compute[82009]:   </os>
Apr 11 18:11:22 user nova-compute[82009]:   <features>
Apr 11 18:11:22 user nova-compute[82009]:     <acpi/>
Apr 11 18:11:22 user nova-compute[82009]:     <apic/>
Apr 11 18:11:22 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:11:22 user nova-compute[82009]:   </features>
Apr 11 18:11:22 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:11:22 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:11:22 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:11:22 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:11:22 user nova-compute[82009]:   </clock>
Apr 11 18:11:22 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:11:22 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:11:22 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:11:22 user nova-compute[82009]:   </cpu>
Apr 11 18:11:22 user nova-compute[82009]:   <devices>
Apr 11 18:11:22 user nova-compute[82009]:     <disk type="file" device="cdrom">
Apr 11 18:11:22 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 18:11:22 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07/disk.config"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="hda" bus="ide"/>
Apr 11 18:11:22 user nova-compute[82009]:     </disk>
Apr 11 18:11:22 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:11:22 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:11:22 user nova-compute[82009]:       <source dev="/dev/sdc"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <serial>ffe808d1-d7d3-4c81-b366-1b777fac9dee</serial>
Apr 11 18:11:22 user nova-compute[82009]:     </disk>
Apr 11 18:11:22 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:11:22 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:11:22 user nova-compute[82009]:       <source dev="/dev/sde"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <serial>2f7af65f-1aed-4e9e-b945-688f1ab39728</serial>
Apr 11 18:11:22 user nova-compute[82009]:     </disk>
Apr 11 18:11:22 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:11:22 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:11:22 user nova-compute[82009]:       <source dev="/dev/sdg"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="vdc" bus="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <serial>858c22bc-7928-4813-9303-f52929365664</serial>
Apr 11 18:11:22 user nova-compute[82009]:     </disk>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:a9:3a:66"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tapced10f2e-f2"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:27:fa:83"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tap218012bb-cb"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:c4:16:29"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tap9b3c6247-4b"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:26:7c:7c"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tapcd517f24-d0"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:13:63:9e"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tapeb5ef9e9-ef"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:80:57:73"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tap5a1999d0-5e"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:22 user nova-compute[82009]:       <mac address="fa:16:3e:e7:15:b9"/>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:22 user nova-compute[82009]:       <target dev="tapccbdc6f5-62"/>
Apr 11 18:11:22 user nova-compute[82009]:     </interface>
Apr 11 18:11:22 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:11:22 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07/console.log" append="off"/>
Apr 11 18:11:22 user nova-compute[82009]:     </serial>
Apr 11 18:11:22 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:11:22 user nova-compute[82009]:     <video>
Apr 11 18:11:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:22 user nova-compute[82009]:     </video>
Apr 11 18:11:22 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:11:22 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:11:22 user nova-compute[82009]:     </rng>
Apr 11 18:11:22 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:11:22 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:11:22 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:11:22 user nova-compute[82009]:     </memballoon>
Apr 11 18:11:22 user nova-compute[82009]:   </devices>
Apr 11 18:11:22 user nova-compute[82009]: </domain>
Apr 11 18:11:22 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced10f2e-f2, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapced10f2e-f2, col_values=(('external_ids', {'iface-id': 'ced10f2e-f2b3-49c0-9232-989b3cc110e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:3a:66', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2')
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap218012bb-cb, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap218012bb-cb, col_values=(('external_ids', {'iface-id': '218012bb-cbbd-412d-85af-8c76ac2c273d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:fa:83', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb')
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b3c6247-4b, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b3c6247-4b, col_values=(('external_ids', {'iface-id': '9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:16:29', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:11:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b')
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd517f24-d0, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd517f24-d0, col_values=(('external_ids', {'iface-id': 'cd517f24-d0a3-4a63-ad6d-9a2271f6d04e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:7c:7c', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:22 user nova-compute[82009]: DEBUG nova.policy [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0')
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:11:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Creating image(s)
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "dc1cfbdc982d9ca26872806f618bfd475f719b2a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "dc1cfbdc982d9ca26872806f618bfd475f719b2a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb5ef9e9-ef, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb5ef9e9-ef, col_values=(('external_ids', {'iface-id': 'eb5ef9e9-efcf-479d-8113-f6c3d284bfaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:63:9e', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef')
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a1999d0-5e, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a1999d0-5e, col_values=(('external_ids', {'iface-id': '5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:57:73', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e')
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.part --force-share --output=json" returned: 0 in 0.261s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.virt.images [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.part /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccbdc6f5-62, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccbdc6f5-62, col_values=(('external_ids', {'iface-id': 'ccbdc6f5-6226-4b61-8ec9-45e77798e8aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:15:b9', 'vm-uuid': 'cd86b2f4-002e-48ab-987c-b081681b5e07'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.part /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.converted" returned: 0 in 0.193s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Successfully created port: 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: INFO os_vif [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62')
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:24 user nova-compute[82009]: WARNING nova.compute.manager [req-a9f81ed1-8c04-439a-b647-9afdd1444f6f req-5c9e6480-d220-43fd-a9ec-21713a965be7 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance with vm_state building and task_state spawning.
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "dc1cfbdc982d9ca26872806f618bfd475f719b2a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.244s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] No BDM found with device name hda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] No VIF found with MAC fa:16:3e:a9:3a:66, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] No VIF found with MAC fa:16:3e:13:63:9e, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:11:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Using config drive
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json" returned: 0 in 0.172s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "dc1cfbdc982d9ca26872806f618bfd475f719b2a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "dc1cfbdc982d9ca26872806f618bfd475f719b2a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Creating config drive at /opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07/disk.config
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptpp809hv {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptpp809hv" returned: 0 in 0.056s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a,backing_fmt=raw /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a,backing_fmt=raw /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk 1073741824" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "dc1cfbdc982d9ca26872806f618bfd475f719b2a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:24 user nova-compute[82009]: WARNING nova.compute.manager [req-9d0c3e2b-f281-4049-b023-9cfb83642a93 req-165adf8d-d9ba-4045-bcea-a1ea476b1b3e service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 for instance with vm_state building and task_state spawning.
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Cannot resize image /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'migration_context' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Ensure instance console log exists: /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Successfully updated port: 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance network_info: |[{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Start _get_guest_xml network_info=[{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:11:19Z,direct_url=<?>,disk_format='qcow2',id=88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de,min_disk=0,min_ram=0,name='tempest-scenario-img--1156556381',owner='a70e133c013140e1a17804737f4e3ef7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:11:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:11:19Z,direct_url=<?>,disk_format='qcow2',id=88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de,min_disk=0,min_ram=0,name='tempest-scenario-img--1156556381',owner='a70e133c013140e1a17804737f4e3ef7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:11:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-621502840',display_name='tempest-TestMinimumBasicScenario-server-621502840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-621502840',id=12,image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw==',key_name='tempest-TestMinimumBasicScenario-1430519022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-tfsvslnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:11:23Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=2e78a3ea-f132-4da0-81f1-d6745390b0d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:11:26 user nova-compute[82009]:   <uuid>2e78a3ea-f132-4da0-81f1-d6745390b0d6</uuid>
Apr 11 18:11:26 user nova-compute[82009]:   <name>instance-0000000c</name>
Apr 11 18:11:26 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:11:26 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:11:26 user nova-compute[82009]:   <metadata>
Apr 11 18:11:26 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:11:26 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:11:26 user nova-compute[82009]:       <nova:name>tempest-TestMinimumBasicScenario-server-621502840</nova:name>
Apr 11 18:11:26 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:11:26</nova:creationTime>
Apr 11 18:11:26 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:11:26 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:11:26 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:11:26 user nova-compute[82009]:       <nova:owner>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:user uuid="dd1c4ded6c544d6eb16e9086c6259750">tempest-TestMinimumBasicScenario-492134328-project-member</nova:user>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:project uuid="a70e133c013140e1a17804737f4e3ef7">tempest-TestMinimumBasicScenario-492134328</nova:project>
Apr 11 18:11:26 user nova-compute[82009]:       </nova:owner>
Apr 11 18:11:26 user nova-compute[82009]:       <nova:root type="image" uuid="88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de"/>
Apr 11 18:11:26 user nova-compute[82009]:       <nova:ports>
Apr 11 18:11:26 user nova-compute[82009]:         <nova:port uuid="9f1432e1-1448-4815-a940-c004344002a0">
Apr 11 18:11:26 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:11:26 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:26 user nova-compute[82009]:       </nova:ports>
Apr 11 18:11:26 user nova-compute[82009]:     </nova:instance>
Apr 11 18:11:26 user nova-compute[82009]:   </metadata>
Apr 11 18:11:26 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:11:26 user nova-compute[82009]:     <system>
Apr 11 18:11:26 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:11:26 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:11:26 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:11:26 user nova-compute[82009]:       <entry name="serial">2e78a3ea-f132-4da0-81f1-d6745390b0d6</entry>
Apr 11 18:11:26 user nova-compute[82009]:       <entry name="uuid">2e78a3ea-f132-4da0-81f1-d6745390b0d6</entry>
Apr 11 18:11:26 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:11:26 user nova-compute[82009]:     </system>
Apr 11 18:11:26 user nova-compute[82009]:   </sysinfo>
Apr 11 18:11:26 user nova-compute[82009]:   <os>
Apr 11 18:11:26 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:11:26 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:11:26 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:11:26 user nova-compute[82009]:   </os>
Apr 11 18:11:26 user nova-compute[82009]:   <features>
Apr 11 18:11:26 user nova-compute[82009]:     <acpi/>
Apr 11 18:11:26 user nova-compute[82009]:     <apic/>
Apr 11 18:11:26 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:11:26 user nova-compute[82009]:   </features>
Apr 11 18:11:26 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:11:26 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:11:26 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:11:26 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:11:26 user nova-compute[82009]:   </clock>
Apr 11 18:11:26 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:11:26 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:11:26 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:11:26 user nova-compute[82009]:   </cpu>
Apr 11 18:11:26 user nova-compute[82009]:   <devices>
Apr 11 18:11:26 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:11:26 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:11:26 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk"/>
Apr 11 18:11:26 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:11:26 user nova-compute[82009]:     </disk>
Apr 11 18:11:26 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:26 user nova-compute[82009]:       <mac address="fa:16:3e:43:43:b7"/>
Apr 11 18:11:26 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:26 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:26 user nova-compute[82009]:       <target dev="tap9f1432e1-14"/>
Apr 11 18:11:26 user nova-compute[82009]:     </interface>
Apr 11 18:11:26 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:11:26 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/console.log" append="off"/>
Apr 11 18:11:26 user nova-compute[82009]:     </serial>
Apr 11 18:11:26 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:11:26 user nova-compute[82009]:     <video>
Apr 11 18:11:26 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:26 user nova-compute[82009]:     </video>
Apr 11 18:11:26 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:11:26 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:11:26 user nova-compute[82009]:     </rng>
Apr 11 18:11:26 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:11:26 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:11:26 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:11:26 user nova-compute[82009]:     </memballoon>
Apr 11 18:11:26 user nova-compute[82009]:   </devices>
Apr 11 18:11:26 user nova-compute[82009]: </domain>
Apr 11 18:11:26 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-621502840',display_name='tempest-TestMinimumBasicScenario-server-621502840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-621502840',id=12,image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw==',key_name='tempest-TestMinimumBasicScenario-1430519022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-tfsvslnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:11:23Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=2e78a3ea-f132-4da0-81f1-d6745390b0d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG os_vif [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f1432e1-14, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f1432e1-14, col_values=(('external_ids', {'iface-id': '9f1432e1-1448-4815-a940-c004344002a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:43:b7', 'vm-uuid': '2e78a3ea-f132-4da0-81f1-d6745390b0d6'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance with vm_state building and task_state spawning.
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance with vm_state building and task_state spawning.
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.compute.manager [req-8ad794c2-4ba0-4c93-8a6c-c352eea816dc req-d41af85a-bf78-460c-ba7f-9aad5c2fb0ee service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance with vm_state building and task_state spawning.
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: INFO os_vif [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14')
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No VIF found with MAC fa:16:3e:43:43:b7, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 for instance with vm_state building and task_state spawning.
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:26 user nova-compute[82009]: WARNING nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance with vm_state building and task_state spawning.
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-changed-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing instance network info cache due to event network-changed-9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing network info cache for port 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG nova.network.neutron [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updated VIF entry in instance network info cache for port 9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG nova.network.neutron [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:27 user nova-compute[82009]: WARNING nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance with vm_state building and task_state spawning.
Apr 11 18:11:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:27 user nova-compute[82009]: WARNING nova.compute.manager [req-54bfb949-be02-4af7-a5d8-484229a8d551 req-db97f122-707a-466d-88c2-6950474a785c service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d for instance with vm_state building and task_state spawning.
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d4cbe43d-fee4-47b7-b49a-a984629a9386 req-89da0377-413f-46cf-9e85-1023841a741b service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:28 user nova-compute[82009]: WARNING nova.compute.manager [req-d5b7246c-a692-4fab-80c8-aaf7c30e6e2f req-eb745ad7-633f-4a21-838a-a93b3b783be6 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d for instance with vm_state building and task_state spawning.
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:30 user nova-compute[82009]: WARNING nova.compute.manager [req-c155e899-f43c-449b-8c4c-4a139704dc09 req-ef09708e-333d-491f-af46-741a93e5d2f0 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance with vm_state building and task_state spawning.
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:31 user nova-compute[82009]: WARNING nova.compute.manager [req-f2fe6939-ed9b-4871-8463-d89bbae23ef3 req-e44a4e9b-5e79-44fa-a983-42451b6c6cb5 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance with vm_state building and task_state spawning.
Apr 11 18:11:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236691.6898093, 3aedb5f4-32cf-497c-8035-0f694cbf78cf => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:11:31 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] VM Resumed (Lifecycle Event)
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:11:31 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance spawned successfully.
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236691.6969304, 3aedb5f4-32cf-497c-8035-0f694cbf78cf => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] VM Started (Lifecycle Event)
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Took 17.87 seconds to spawn the instance on the hypervisor.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Took 34.79 seconds to build instance.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a4e712b8-515a-4bac-a416-222f17c240bf tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.892s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236692.4066322, 2e78a3ea-f132-4da0-81f1-d6745390b0d6 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] VM Resumed (Lifecycle Event)
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance spawned successfully.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236692.4084187, 2e78a3ea-f132-4da0-81f1-d6745390b0d6 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] VM Started (Lifecycle Event)
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Took 9.49 seconds to spawn the instance on the hypervisor.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:32 user nova-compute[82009]: INFO nova.compute.manager [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Took 10.53 seconds to build instance.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b006176-2f76-44ec-9324-bf67ec34f40f tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.688s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:32 user nova-compute[82009]: WARNING nova.compute.manager [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance with vm_state building and task_state spawning.
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:32 user nova-compute[82009]: WARNING nova.compute.manager [req-7dcf6d38-8b40-4412-b0c1-00b9a5498b64 req-700b9de9-3b3a-40f1-bbca-1b78ab14d204 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance with vm_state building and task_state spawning.
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:33 user nova-compute[82009]: WARNING nova.compute.manager [req-cd906df1-9c57-4134-b72d-99a242f741b9 req-f480e33b-c6de-4c5b-ae25-d5c99cff370a service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance with vm_state building and task_state spawning.
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236693.228101, cd86b2f4-002e-48ab-987c-b081681b5e07 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] VM Resumed (Lifecycle Event)
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance spawned successfully.
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236693.228394, cd86b2f4-002e-48ab-987c-b081681b5e07 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] VM Started (Lifecycle Event)
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Took 18.79 seconds to spawn the instance on the hypervisor.
Apr 11 18:11:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:11:33 user nova-compute[82009]: INFO nova.compute.manager [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Took 36.19 seconds to build instance.
Apr 11 18:11:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ff83e9a1-0a04-4ebf-824a-24eadd30dd8f tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.303s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:49 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:49 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updating instance_info_cache with network_info: [{"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-ce16e1aa-f16b-40be-945a-78265fb23638" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:51 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:11:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: INFO nova.compute.manager [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Rescuing
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-unplugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-unplugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:55 user nova-compute[82009]: WARNING nova.compute.manager [req-29e260c1-f858-4c72-b037-bfb5665ac53d req-ed9d0fb9-f756-403b-bbb8-b18d0a81e8be service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-unplugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state active and task_state rescuing.
Apr 11 18:11:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:55 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7112MB free_disk=26.6163330078125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance destroyed successfully.
Apr 11 18:11:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Attempting rescue
Apr 11 18:11:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82009) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:11:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Creating image(s)
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c107e5ac-af58-4702-aa62-253f3424c585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 67cf8e45-399b-4709-a994-15daf849132a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance ce16e1aa-f16b-40be-945a-78265fb23638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance cd86b2f4-002e-48ab-987c-b081681b5e07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue" returned: 0 in 0.047s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'migration_context' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Start _get_guest_xml network_info=[{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:c0:ca:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'resources' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'numa_topology' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:56 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:56 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1852666843',display_name='tempest-ServerRescueNegativeTestJSON-server-1852666843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1852666843',id=3,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xxj14qfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:23Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=216db027-e3a6-4027-9aa7-07031623c674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:c0:ca:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:c0:ca:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'pci_devices' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:11:56 user nova-compute[82009]:   <uuid>216db027-e3a6-4027-9aa7-07031623c674</uuid>
Apr 11 18:11:56 user nova-compute[82009]:   <name>instance-00000003</name>
Apr 11 18:11:56 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:11:56 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:11:56 user nova-compute[82009]:   <metadata>
Apr 11 18:11:56 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:11:56 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:11:56 user nova-compute[82009]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1852666843</nova:name>
Apr 11 18:11:56 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:11:56</nova:creationTime>
Apr 11 18:11:56 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:11:56 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:11:56 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:11:56 user nova-compute[82009]:       <nova:owner>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:user uuid="908e0b5a1ce14f5cb636eda79ac77f7b">tempest-ServerRescueNegativeTestJSON-223229619-project-member</nova:user>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:project uuid="c10b5a531bbc41d680d137a766a8b2d9">tempest-ServerRescueNegativeTestJSON-223229619</nova:project>
Apr 11 18:11:56 user nova-compute[82009]:       </nova:owner>
Apr 11 18:11:56 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:11:56 user nova-compute[82009]:       <nova:ports>
Apr 11 18:11:56 user nova-compute[82009]:         <nova:port uuid="416d3421-181a-44dd-9e4c-438c8289541d">
Apr 11 18:11:56 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:11:56 user nova-compute[82009]:         </nova:port>
Apr 11 18:11:56 user nova-compute[82009]:       </nova:ports>
Apr 11 18:11:56 user nova-compute[82009]:     </nova:instance>
Apr 11 18:11:56 user nova-compute[82009]:   </metadata>
Apr 11 18:11:56 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:11:56 user nova-compute[82009]:     <system>
Apr 11 18:11:56 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:11:56 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:11:56 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:11:56 user nova-compute[82009]:       <entry name="serial">216db027-e3a6-4027-9aa7-07031623c674</entry>
Apr 11 18:11:56 user nova-compute[82009]:       <entry name="uuid">216db027-e3a6-4027-9aa7-07031623c674</entry>
Apr 11 18:11:56 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:11:56 user nova-compute[82009]:     </system>
Apr 11 18:11:56 user nova-compute[82009]:   </sysinfo>
Apr 11 18:11:56 user nova-compute[82009]:   <os>
Apr 11 18:11:56 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:11:56 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:11:56 user nova-compute[82009]:   </os>
Apr 11 18:11:56 user nova-compute[82009]:   <features>
Apr 11 18:11:56 user nova-compute[82009]:     <acpi/>
Apr 11 18:11:56 user nova-compute[82009]:     <apic/>
Apr 11 18:11:56 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:11:56 user nova-compute[82009]:   </features>
Apr 11 18:11:56 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:11:56 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:11:56 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:11:56 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:11:56 user nova-compute[82009]:   </clock>
Apr 11 18:11:56 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:11:56 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:11:56 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:11:56 user nova-compute[82009]:   </cpu>
Apr 11 18:11:56 user nova-compute[82009]:   <devices>
Apr 11 18:11:56 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:11:56 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:11:56 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue"/>
Apr 11 18:11:56 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:11:56 user nova-compute[82009]:     </disk>
Apr 11 18:11:56 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:11:56 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:11:56 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk"/>
Apr 11 18:11:56 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:11:56 user nova-compute[82009]:     </disk>
Apr 11 18:11:56 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:11:56 user nova-compute[82009]:       <mac address="fa:16:3e:c0:ca:b6"/>
Apr 11 18:11:56 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:56 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:11:56 user nova-compute[82009]:       <target dev="tap416d3421-18"/>
Apr 11 18:11:56 user nova-compute[82009]:     </interface>
Apr 11 18:11:56 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:11:56 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/console.log" append="off"/>
Apr 11 18:11:56 user nova-compute[82009]:     </serial>
Apr 11 18:11:56 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:11:56 user nova-compute[82009]:     <video>
Apr 11 18:11:56 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:11:56 user nova-compute[82009]:     </video>
Apr 11 18:11:56 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:11:56 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:11:56 user nova-compute[82009]:     </rng>
Apr 11 18:11:56 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:11:56 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:11:56 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:11:56 user nova-compute[82009]:     </memballoon>
Apr 11 18:11:56 user nova-compute[82009]:   </devices>
Apr 11 18:11:56 user nova-compute[82009]: </domain>
Apr 11 18:11:56 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:11:56 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance destroyed successfully.
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:c0:ca:b6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "ce16e1aa-f16b-40be-945a-78265fb23638" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:56 user nova-compute[82009]: INFO nova.compute.manager [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Terminating instance
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.manager [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:11:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Instance destroyed successfully.
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lazy-loading 'resources' on Instance uuid ce16e1aa-f16b-40be-945a-78265fb23638 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-666810633',display_name='tempest-VolumesActionsTest-instance-666810633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-666810633',id=2,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba695867a2a94155820b99174b93499b',ramdisk_id='',reservation_id='r-hcgz31f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1624489732',owner_user_name='tempest-VolumesActionsTest-1624489732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:24Z,user_data=None,user_id='20dbffe38f4e4be08599eb1f2fa2bc38',uuid=ce16e1aa-f16b-40be-945a-78265fb23638,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Converting VIF {"id": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "address": "fa:16:3e:0f:79:82", "network": {"id": "60e8714f-81c9-47a6-adab-bf1ca8ef28b1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-8675994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba695867a2a94155820b99174b93499b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220357-3d", "ovs_interfaceid": "8e220357-3dfe-4e09-a0d7-2a3f519a9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG os_vif [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e220357-3d, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:57 user nova-compute[82009]: INFO os_vif [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:79:82,bridge_name='br-int',has_traffic_filtering=True,id=8e220357-3dfe-4e09-a0d7-2a3f519a9971,network=Network(60e8714f-81c9-47a6-adab-bf1ca8ef28b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220357-3d')
Apr 11 18:11:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Deleting instance files /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638_del
Apr 11 18:11:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Deletion of /opt/stack/data/nova/instances/ce16e1aa-f16b-40be-945a-78265fb23638_del complete
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:57 user nova-compute[82009]: WARNING nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state active and task_state rescuing.
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-vif-unplugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] No waiting events found dispatching network-vif-unplugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-vif-unplugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Acquiring lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] Lock "ce16e1aa-f16b-40be-945a-78265fb23638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] No waiting events found dispatching network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:57 user nova-compute[82009]: WARNING nova.compute.manager [req-86bdde31-e85a-4d64-9f18-ff3496dac0db req-b993faf6-37b2-4d24-aac7-2a3250793a4a service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received unexpected event network-vif-plugged-8e220357-3dfe-4e09-a0d7-2a3f519a9971 for instance with vm_state active and task_state deleting.
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82009) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 18:11:57 user nova-compute[82009]: INFO nova.virt.libvirt.host [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] UEFI support detected
Apr 11 18:11:57 user nova-compute[82009]: INFO nova.compute.manager [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:58 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Took 0.66 seconds to deallocate network for instance.
Apr 11 18:11:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Received event network-vif-deleted-8e220357-3dfe-4e09-a0d7-2a3f519a9971 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:58 user nova-compute[82009]: INFO nova.compute.manager [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Neutron deleted interface 8e220357-3dfe-4e09-a0d7-2a3f519a9971; detaching it from the instance and deleting it from the info cache
Apr 11 18:11:58 user nova-compute[82009]: DEBUG nova.network.neutron [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-031477b4-c854-4cbd-bf49-8bfb05042e0f req-b632b6f1-492e-44c4-96ae-021fdac51714 service nova] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Detach interface failed, port_id=8e220357-3dfe-4e09-a0d7-2a3f519a9971, reason: Instance ce16e1aa-f16b-40be-945a-78265fb23638 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:11:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:58 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Deleted allocations for instance ce16e1aa-f16b-40be-945a-78265fb23638
Apr 11 18:11:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-37b01c15-b20a-4780-8ec8-7321f5f4cd5a tempest-VolumesActionsTest-1624489732 tempest-VolumesActionsTest-1624489732-project-member] Lock "ce16e1aa-f16b-40be-945a-78265fb23638" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:59 user nova-compute[82009]: WARNING nova.compute.manager [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state active and task_state rescuing.
Apr 11 18:11:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:11:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:11:59 user nova-compute[82009]: WARNING nova.compute.manager [req-0defdb91-4c9d-44f8-867b-aae71a13e2c7 req-489fff40-7314-4ed0-9800-11628fc39808 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state active and task_state rescuing.
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 216db027-e3a6-4027-9aa7-07031623c674 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236720.323608, 216db027-e3a6-4027-9aa7-07031623c674 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:12:00 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] VM Resumed (Lifecycle Event)
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-bbc6da56-0a00-41ae-8b1d-9cfe889bd8e1 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:12:00 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236720.3245888, 216db027-e3a6-4027-9aa7-07031623c674 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:12:00 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] VM Started (Lifecycle Event)
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lazy-loading 'flavor' on Instance uuid b35fb527-2e5c-449f-a5d5-339595f3dc75 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:00 user nova-compute[82009]: INFO nova.compute.manager [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Attaching volume b14d1177-4790-4a6e-9746-66fe5c84faf4 to /dev/vdb
Apr 11 18:12:00 user nova-compute[82009]: DEBUG os_brick.utils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c6567-bf11-4e76-a315-db7d7f2779bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12647cd-e53f-49b7-9951-0d222b8d78ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32c4c7-c8c3-4cee-9f1a-5409b1766e65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d2dd3-1270-4fda-8d8e-44a9329878ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:00 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:12:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bedf4f-df6d-47af-a957-981b02449ce5]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG os_brick.utils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:00 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Updating existing volume attachment record: ab03bbf4-838e-475b-858f-5c1fef9c640d {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:12:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing instance network info cache due to event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:02 user nova-compute[82009]: DEBUG nova.network.neutron [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updated VIF entry in instance network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:02 user nova-compute[82009]: DEBUG nova.network.neutron [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-58940665-13de-48ac-8f6b-2f5cd0e4d35e req-f391d999-7373-471f-b70d-aed473a2b630 service nova] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:02 user nova-compute[82009]: INFO nova.compute.manager [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] instance snapshotting
Apr 11 18:12:02 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Beginning live snapshot process
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.198s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7bxqf719/7a967e46b22a420093572494bcff120f.delta 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7bxqf719/7a967e46b22a420093572494bcff120f.delta 1073741824" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 18:12:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 18:12:05 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7bxqf719/7a967e46b22a420093572494bcff120f.delta /opt/stack/data/nova/instances/snapshots/tmp7bxqf719/7a967e46b22a420093572494bcff120f {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7bxqf719/7a967e46b22a420093572494bcff120f.delta /opt/stack/data/nova/instances/snapshots/tmp7bxqf719/7a967e46b22a420093572494bcff120f" returned: 0 in 0.290s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Snapshot extracted, beginning image upload
Apr 11 18:12:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acwmCLND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:05 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:05 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:05 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b97d58-c280-4219-8fc2-d6c5bf8cf886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:12:05 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffacf35-4fba-4b60-913d-a95a6770849a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4] added
Apr 11 18:12:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e62f4a1-f40e-4200-a313-7c5d3d657720]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4df1c1-0780-4336-9241-f3bb0fd57ad8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acwmCLND {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acwmCLND" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d1279-9612-4ce4-a914-947d488dfcdc]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'acwmCLND'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de51cd-be5f-47b6-92e2-ab3acdeb5f9b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[805edc6b-6cd4-4457-83a5-ad8eb99124a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1219e2-b1cf-4b5d-ba41-486ffdb1ab3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260]
Apr 11 18:12:05 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d016a1-1ae5-41b9-89c7-4580313f1d93]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1bdc58-1277-4686-8e2f-e3395fc0c380]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 (non-flash)
Apr 11 18:12:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0609b09-f7ab-48f5-a480-3b8bb1c24b4f]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acwmCLND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:12:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26534326365356165', 'path': '/dev/sdh'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534326365356165', 'path': '/dev/sdh'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:12:06 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lazy-loading 'flavor' on Instance uuid b35fb527-2e5c-449f-a5d5-339595f3dc75 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:12:06 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:06 user nova-compute[82009]:   <source dev="/dev/sdh"/>
Apr 11 18:12:06 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:06 user nova-compute[82009]:   <serial>b14d1177-4790-4a6e-9746-66fe5c84faf4</serial>
Apr 11 18:12:06 user nova-compute[82009]: </disk>
Apr 11 18:12:06 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:12:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] No VIF found with MAC fa:16:3e:68:a1:00, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:12:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a7f1600-bf91-4f96-b5e1-bdecabff13b3 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.844s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Snapshot image upload complete
Apr 11 18:12:07 user nova-compute[82009]: INFO nova.compute.manager [None req-88fb6c39-1d65-4177-b84b-d20372224cf1 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Took 4.84 seconds to snapshot the instance on the hypervisor.
Apr 11 18:12:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-changed-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Refreshing instance network info cache due to event network-changed-98cc8035-8d3e-47cf-9758-c7172120ac70. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Refreshing network info cache for port 98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:08 user nova-compute[82009]: INFO nova.compute.manager [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Terminating instance
Apr 11 18:12:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updated VIF entry in instance network info cache for port 98cc8035-8d3e-47cf-9758-c7172120ac70. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3c2cc787-ddeb-4f99-a3d9-58e898603d81 req-2519e309-23ef-46f0-aafe-8dda330f1b58 service nova] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Instance destroyed successfully.
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lazy-loading 'resources' on Instance uuid b35fb527-2e5c-449f-a5d5-339595f3dc75 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-684803225',display_name='tempest-DeleteServersTestJSON-server-684803225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-684803225',id=4,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972a578943144e9d8b27c8c1367a7ab0',ramdisk_id='',reservation_id='r-pmxud2pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1250553535',owner_user_name='tempest-DeleteServersTestJSON-1250553535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:26Z,user_data=None,user_id='5fd5ab7a54de4c7eae01368522ec9b6f',uuid=b35fb527-2e5c-449f-a5d5-339595f3dc75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Converting VIF {"id": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "address": "fa:16:3e:68:a1:00", "network": {"id": "4ab57744-6e8a-413d-af38-dc59ba765d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1411750473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972a578943144e9d8b27c8c1367a7ab0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e6da2b-db", "ovs_interfaceid": "77e6da2b-db86-4426-8c43-a0c31e8f7d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_vif [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77e6da2b-db, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:09 user nova-compute[82009]: INFO os_vif [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:a1:00,bridge_name='br-int',has_traffic_filtering=True,id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b,network=Network(4ab57744-6e8a-413d-af38-dc59ba765d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e6da2b-db')
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acwmCLND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:09 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0621e2d-5a94-474f-987a-d079d5ef17b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:09 user nova-compute[82009]: No targets found.
Apr 11 18:12:09 user nova-compute[82009]: iSNS:
Apr 11 18:12:09 user nova-compute[82009]: No targets found.
Apr 11 18:12:09 user nova-compute[82009]: STATIC:
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:09 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:09 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:09 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:09 user nova-compute[82009]: No targets found.
Apr 11 18:12:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:09 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:09 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f739579-e829-4d28-b091-aaad714f8b0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8285d3c-ca5f-4d23-9d2b-a97aa040e873]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 (non-flash)
Apr 11 18:12:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e024dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4'): ({'sdh'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Removing single pathed devices sdh {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc5ea84-c7eb-416a-9429-4a2ef5f81d90]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a6faf-50c1-43af-a1a4-581b41e734cc]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Flushing IO for device /dev/sdh {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206ab18-15a0-4fd5-a0d9-153151177832]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f0391-ac44-43fe-9e31-fb1f30f8727d]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] SCSI volumes sdh have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca66e5f-9360-49f7-9473-4f31921bc0ae]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf358b-9ff2-4261-ba6f-e3917cad6282]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260]
Apr 11 18:12:09 user nova-compute[82009]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b14d1177-4790-4a6e-9746-66fe5c84faf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dcf78e-4b20-4c99-bc58-4ac088045612]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] <== disconnect_volume: return (362ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Deleting instance files /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75_del
Apr 11 18:12:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Deletion of /opt/stack/data/nova/instances/b35fb527-2e5c-449f-a5d5-339595f3dc75_del complete
Apr 11 18:12:09 user nova-compute[82009]: INFO nova.compute.manager [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 11 18:12:09 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:12:09 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:10 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Took 0.49 seconds to deallocate network for instance.
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-vif-deleted-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:10 user nova-compute[82009]: INFO nova.compute.manager [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Neutron deleted interface 77e6da2b-db86-4426-8c43-a0c31e8f7d7b; detaching it from the instance and deleting it from the info cache
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-vif-unplugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] No waiting events found dispatching network-vif-unplugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-vif-unplugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received event network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Acquiring lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] No waiting events found dispatching network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:10 user nova-compute[82009]: WARNING nova.compute.manager [req-f1d228be-cd5f-4a26-9185-6d379d0ed3fe req-b9d4f93c-35e1-4a4d-b3b3-38524af02ff0 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Received unexpected event network-vif-plugged-77e6da2b-db86-4426-8c43-a0c31e8f7d7b for instance with vm_state active and task_state deleting.
Apr 11 18:12:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-a36b47fc-4f06-409e-a5ec-0c0bc22a795a req-2932ddb5-03e0-44bf-b7cb-2228d15b5e63 service nova] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Detach interface failed, port_id=77e6da2b-db86-4426-8c43-a0c31e8f7d7b, reason: Instance b35fb527-2e5c-449f-a5d5-339595f3dc75 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:12:10 user nova-compute[82009]: INFO nova.compute.manager [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Took 0.84 seconds to detach 1 volumes for instance.
Apr 11 18:12:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:11 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:12:11 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:12:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:11 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Deleted allocations for instance b35fb527-2e5c-449f-a5d5-339595f3dc75
Apr 11 18:12:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-62273801-330c-4692-90c2-618181682102 tempest-DeleteServersTestJSON-1250553535 tempest-DeleteServersTestJSON-1250553535-project-member] Lock "b35fb527-2e5c-449f-a5d5-339595f3dc75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:12 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236717.3040938, ce16e1aa-f16b-40be-945a-78265fb23638 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:12:12 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] VM Stopped (Lifecycle Event)
Apr 11 18:12:12 user nova-compute[82009]: DEBUG nova.compute.manager [None req-babd66dd-ebc0-41ce-baa5-1b7e1f4d2334 None None] [instance: ce16e1aa-f16b-40be-945a-78265fb23638] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG nova.compute.manager [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-changed-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG nova.compute.manager [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Refreshing instance network info cache due to event network-changed-c8a46ee6-74bb-42ed-a653-649dc130b0f3. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Acquiring lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Acquired lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG nova.network.neutron [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Refreshing network info cache for port c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG nova.objects.instance [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'flavor' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:18 user nova-compute[82009]: INFO nova.compute.manager [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Attaching volume f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 to /dev/vdb
Apr 11 18:12:19 user nova-compute[82009]: DEBUG os_brick.utils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853ca28-b8dd-4828-b80b-6031eaca8fa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3641de35-c0bc-43bb-84fc-dcb1eb5ed0c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[263aa202-af26-4c6b-aede-a76ce8dff354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec44b8-3d6d-4ca2-82b3-899f240b03d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:19 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:12:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dce684-c13d-4ee6-a883-4b7df114486f]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG os_brick.utils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updating existing volume attachment record: ff40cfb0-9101-4031-bf9b-47c33f87f6c3 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:12:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updated VIF entry in instance network info cache for port c8a46ee6-74bb-42ed-a653-649dc130b0f3. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updating instance_info_cache with network_info: [{"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-04f7b91c-797d-4c72-b815-6b6b507d8cc8 req-bbda42fe-39ea-469f-afbd-6c5484aa4bc8 service nova] Releasing lock "refresh_cache-c107e5ac-af58-4702-aa62-253f3424c585" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-changed-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Refreshing instance network info cache due to event network-changed-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Acquiring lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Acquired lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Refreshing network info cache for port 83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Updated VIF entry in instance network info cache for port 83cfb5bf-92c3-4c75-b57f-0ad3382eb92a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Updating instance_info_cache with network_info: [{"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-268de4d9-69fe-4033-8d62-f7a83435b3da req-9929ea15-5c68-4308-a143-f1facc8cd6e5 service nova] Releasing lock "refresh_cache-67cf8e45-399b-4709-a994-15daf849132a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'flavor' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:22 user nova-compute[82009]: INFO nova.compute.manager [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Attaching volume ecc81a75-b271-47fd-b9ae-26654e484252 to /dev/sdc
Apr 11 18:12:22 user nova-compute[82009]: DEBUG os_brick.utils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad325ff9-b71e-4779-b632-c11ded2c1236]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db0e55f-e419-4032-bc54-caff2749a12f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50c85c6-7726-4144-843b-426494e52143]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0bd82-6a96-4b43-aafa-4035c21f55d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:22 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:12:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb26370-ca17-48f3-95e3-858c223b5bcc]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG os_brick.utils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:22 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Updating existing volume attachment record: c8d2d9a4-8085-41f5-8982-e02591e90d86 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:23 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:23 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:23 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[18af7726-693e-48b4-b286-f9fc6a340eb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:12:23 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe5724b-a6b4-46ef-81da-e53107ce2621]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139] added
Apr 11 18:12:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e800beb-9254-404b-b5ab-f9127f6b426d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf4513-9a82-4b8b-b08a-49f80c847766]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOvpAUnI {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOvpAUnI" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fdca1-b6fb-4eec-8f16-793bafb9e90f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOvpAUnI'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d1fac-3d2a-4db1-8b51-1499c18f9151]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5355ca21-1525-46b5-b574-268c870c0967]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a2bb9-9a53-4874-ada5-54a22504583a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]
Apr 11 18:12:23 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee8e450-30a5-43d6-808f-c2c516c6d191]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[af074ffa-4f26-4a60-90df-72f1d977fdf1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddceb56-f976-4d6c-87d8-b96be943c443]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236729.1750238, b35fb527-2e5c-449f-a5d5-339595f3dc75 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:12:24 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] VM Stopped (Lifecycle Event)
Apr 11 18:12:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-957abfa7-1d87-41bb-ae72-1adefae49fca None None] [instance: b35fb527-2e5c-449f-a5d5-339595f3dc75] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23333623866343833', 'path': '/dev/sdh'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333623866343833', 'path': '/dev/sdh'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG nova.objects.instance [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'flavor' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:12:24 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:24 user nova-compute[82009]:   <source dev="/dev/sdh"/>
Apr 11 18:12:24 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:24 user nova-compute[82009]:   <serial>f821ed7e-c1a1-4b28-a3da-7e2ce97b4139</serial>
Apr 11 18:12:24 user nova-compute[82009]: </disk>
Apr 11 18:12:24 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:12:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] No VIF found with MAC fa:16:3e:5b:a7:91, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:12:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d97a877e-548d-466c-b7f2-73ce663c149f tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.366s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.utils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd325396-fecf-4f9d-8c4d-d87f61fbce27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43bad94-e808-4e95-9c3d-abf3d71d4079]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b520bd1-8134-4c97-8269-4a01d87174b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71c36a1-1998-4db4-b21b-e4098f7c0eef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:26 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:12:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3de22c-d25f-4cea-b791-39d2275db702]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.utils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:26 user nova-compute[82009]: INFO nova.compute.manager [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Swapping volume f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 for 464a3453-7243-4090-9e1d-855d6921a83b
Apr 11 18:12:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:12:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIeEGmZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:27 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:27 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:27 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8f7df5-5c44-43b9-8ddc-6755515780c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:12:27 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3e40c-f3e9-48c0-b68f-00f3b32071e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252] added
Apr 11 18:12:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae388f9f-4e73-4d94-9c11-56ebb9809831]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc7b2cc-b62d-4b26-97c9-54fdc6c3b3fe]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIeEGmZi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIeEGmZi" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc81d86-26e2-4788-be4f-83d4efa636cc]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIeEGmZi'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c40ab-7395-44aa-aa12-95c560d2b85a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57fa3b3-c4d7-4cfc-87c9-3e1795a91223]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[065543c3-97d1-4804-a534-11702570cc6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260]
Apr 11 18:12:27 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530bc30-c4c5-4048-accf-41e77e910cd3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6334ca61-2f17-4461-8e1d-5b8c2b320076]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[140ed60e-4fee-42d9-af16-651441ea7351]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIeEGmZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23134373139623135', 'path': '/dev/sdi'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373139623135', 'path': '/dev/sdi'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'flavor' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:12:28 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:28 user nova-compute[82009]:   <source dev="/dev/sdi"/>
Apr 11 18:12:28 user nova-compute[82009]:   <target dev="sdc" bus="scsi"/>
Apr 11 18:12:28 user nova-compute[82009]:   <serial>ecc81a75-b271-47fd-b9ae-26654e484252</serial>
Apr 11 18:12:28 user nova-compute[82009]:   <address type="drive" controller="0" unit="2"/>
Apr 11 18:12:28 user nova-compute[82009]: </disk>
Apr 11 18:12:28 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No BDM found with device name sda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] No VIF found with MAC fa:16:3e:6f:03:66, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:12:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6180c2f1-7b02-4191-894d-4577dd51d9dc tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.717s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-changed-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Refreshing instance network info cache due to event network-changed-8967a8d4-b607-4572-bfc2-50c7663563cb. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Acquiring lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Acquired lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Refreshing network info cache for port 8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:30 user nova-compute[82009]: INFO nova.compute.manager [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Detaching volume ecc81a75-b271-47fd-b9ae-26654e484252
Apr 11 18:12:30 user nova-compute[82009]: INFO nova.virt.block_device [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Attempting to driver detach volume ecc81a75-b271-47fd-b9ae-26654e484252 from mountpoint /dev/sdc
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Attempting to detach device sdc from instance 67cf8e45-399b-4709-a994-15daf849132a from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:12:30 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:30 user nova-compute[82009]:   <source dev="/dev/sdi"/>
Apr 11 18:12:30 user nova-compute[82009]:   <target dev="sdc" bus="scsi"/>
Apr 11 18:12:30 user nova-compute[82009]:   <serial>ecc81a75-b271-47fd-b9ae-26654e484252</serial>
Apr 11 18:12:30 user nova-compute[82009]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 18:12:30 user nova-compute[82009]: </disk>
Apr 11 18:12:30 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Successfully detached device sdc from instance 67cf8e45-399b-4709-a994-15daf849132a from the persistent domain config.
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 67cf8e45-399b-4709-a994-15daf849132a from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:12:30 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:30 user nova-compute[82009]:   <source dev="/dev/sdi"/>
Apr 11 18:12:30 user nova-compute[82009]:   <target dev="sdc" bus="scsi"/>
Apr 11 18:12:30 user nova-compute[82009]:   <serial>ecc81a75-b271-47fd-b9ae-26654e484252</serial>
Apr 11 18:12:30 user nova-compute[82009]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 18:12:30 user nova-compute[82009]: </disk>
Apr 11 18:12:30 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjGCYXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c107e5ac-af58-4702-aa62-253f3424c585', 'attached_at': '', 'detached_at': '', 'volume_id': '464a3453-7243-4090-9e1d-855d6921a83b', 'serial': '464a3453-7243-4090-9e1d-855d6921a83b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c107e5ac-af58-4702-aa62-253f3424c585', 'attached_at': '', 'detached_at': '', 'volume_id': 'f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'serial'} {{(pid=82009) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjGCYXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:30 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:30 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:30 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c94bf-fe87-4dd5-86b8-7c89335524c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:12:30 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc1d78-28f6-4327-90ab-fc841a990b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b] added
Apr 11 18:12:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b35b77-bf5a-446f-b366-9cc4229f0b1a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae18ea1-e8fe-4303-9f6b-80025e94dd94]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjGCYXsL {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjGCYXsL" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ee47d-16d3-43f6-830a-dff86102ee81]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjGCYXsL'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e504de8e-fff9-4913-9955-015de3271af7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "interface-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "interface-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'flavor' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc27675b-59e2-4ee9-8fd6-52b70c4708be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04195a-6697-4f55-b4b0-2c3b7aa6f15e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260]
Apr 11 18:12:30 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b94ea7e-d841-4948-bf01-ee5c6ecfb7fa]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updated VIF entry in instance network info cache for port 8967a8d4-b607-4572-bfc2-50c7663563cb. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe39ee1-4668-49de-ae00-b66954d89d9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ea9e17d4-128d-46a3-b15e-791a113acec5 req-4ed7af8a-d974-4db1-8684-6506b92134a9 service nova] Releasing lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'pci_requests' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f02dd1-20ee-4a12-b36a-617558237214]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjGCYXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236750.7500758, 67cf8e45-399b-4709-a994-15daf849132a => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:12:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Successfully detached device sdc from instance 67cf8e45-399b-4709-a994-15daf849132a from the live domain config.
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.network.neutron [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIeEGmZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:30 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:30 user nova-compute[82009]: DEBUG nova.policy [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70760a1251b4629afcc8c80ae00c659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9376efafce66467aa4efde41acbce713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG nova.network.neutron [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Successfully created port: 5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26434316363356231', 'path': '/dev/sdj'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434316363356231', 'path': '/dev/sdj'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.989s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lazy-loading 'flavor' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b578749-8cef-46ac-81fb-87c950afe017]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:31 user nova-compute[82009]: No targets found.
Apr 11 18:12:31 user nova-compute[82009]: iSNS:
Apr 11 18:12:31 user nova-compute[82009]: No targets found.
Apr 11 18:12:31 user nova-compute[82009]: STATIC:
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b
Apr 11 18:12:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:31 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:31 user nova-compute[82009]: No targets found.
Apr 11 18:12:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:31 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:31 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6692342-6ee7-4d1d-848d-51998c78f85b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e33611-ff54-4d58-ae5e-b86c797fc740]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e0417490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252'): ({'sdi'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Removing single pathed devices sdi {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfff9d3-2a1b-4e49-9fd1-1a406bd9b418]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca9590-4132-4e3d-87f6-09db2439d870]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Flushing IO for device /dev/sdi {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4daaa-32b5-4149-801e-595dbbc076d3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2432518-88af-4763-a163-fbcd1588d4c3]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] SCSI volumes sdi have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c14eec3-1a71-4a09-aa56-20d78fecc9a1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce29101-d5b7-4b9c-8cf4-f08c9f54da19]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260]
Apr 11 18:12:32 user nova-compute[82009]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:32 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecc81a75-b271-47fd-b9ae-26654e484252 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dae188-fd67-4407-8e54-4dfd2cebb5dc]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] <== disconnect_volume: return (1331ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 3145728 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 102760448 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.network.neutron [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Successfully updated port: 5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquired lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.network.neutron [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-changed-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Refreshing instance network info cache due to event network-changed-5a748b88-931b-4127-848e-b4f2255cd805. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Acquiring lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 176160768 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'flavor' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8e7d5b3-de31-4aab-9858-eee88523c6c6 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.223s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Releasing lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Acquired lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.network.neutron [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Refreshing network info cache for port 5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG os_vif [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a748b88-93, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a748b88-93, col_values=(('external_ids', {'iface-id': '5a748b88-931b-4127-848e-b4f2255cd805', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:13:d8', 'vm-uuid': '9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:33 user nova-compute[82009]: INFO os_vif [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93')
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] attach device xml: <interface type="ethernet">
Apr 11 18:12:33 user nova-compute[82009]:   <mac address="fa:16:3e:f4:13:d8"/>
Apr 11 18:12:33 user nova-compute[82009]:   <model type="virtio"/>
Apr 11 18:12:33 user nova-compute[82009]:   <mtu size="1442"/>
Apr 11 18:12:33 user nova-compute[82009]:   <target dev="tap5a748b88-93"/>
Apr 11 18:12:33 user nova-compute[82009]: </interface>
Apr 11 18:12:33 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 328204288 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:34 user nova-compute[82009]: INFO nova.compute.manager [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Terminating instance
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:34 user nova-compute[82009]: WARNING nova.compute.manager [req-6dcec9b5-6208-43cb-9d43-4ad46cdb8d3a req-e1717f35-8f2c-4a02-a4e1-47b16ecafdb1 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 for instance with vm_state active and task_state None.
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 486539264 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No BDM found with device name hda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No VIF found with MAC fa:16:3e:b3:20:c6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:34 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:34 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:34 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:34</nova:creationTime>
Apr 11 18:12:34 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:34 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:34 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:34 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:34 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:34 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:34 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:34 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:34 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:34 user nova-compute[82009]:     <nova:port uuid="5a748b88-931b-4127-848e-b4f2255cd805">
Apr 11 18:12:34 user nova-compute[82009]:       <nova:ip type="fixed" address="10.10.10.146" ipVersion="4"/>
Apr 11 18:12:34 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:34 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:34 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:34 user nova-compute[82009]:  {{(pid=82009) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-794167d2-d808-4c1b-86ce-fc250e4361ad tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "interface-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.907s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 646971392 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updated VIF entry in instance network info cache for port 5a748b88-931b-4127-848e-b4f2255cd805. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9c13fe9c-e544-4f35-815f-e922526d378e req-226848be-033a-40e1-b76d-479bc8618e56 service nova] Releasing lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'flavor' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-vif-unplugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] No waiting events found dispatching network-vif-unplugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-e029676e-663f-4703-81e3-ec73eb27e4fb req-541e7e78-ca1e-4673-9dc4-0d384b0075fc service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-vif-unplugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:35 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Instance destroyed successfully.
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.objects.instance [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lazy-loading 'resources' on Instance uuid 67cf8e45-399b-4709-a994-15daf849132a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1530757380',display_name='tempest-AttachSCSIVolumeTestJSON-server-1530757380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1530757380',id=8,image_ref='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0URwNWIYJkMnsH7m5y9Ix5AGr3fUW1mmaNHKkOgHReSsf7+ifIsMRKy3D+5OUYVR+uALgWoGRZVY/SK5EoQHgh4Tqa+XoLfK43xtpIx2sSmLqhVUgk3pmOtflWsIvJBw==',key_name='tempest-keypair-752484616',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b181392922e741a784b8a0d59ca79f7f',ramdisk_id='',reservation_id='r-ovy1ftps',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f23e66cf-31f3-42e5-a4a8-81cf2a978f9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1972641769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1972641769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b6375313b85465aa965faf4b75eec5c',uuid=67cf8e45-399b-4709-a994-15daf849132a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Converting VIF {"id": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "address": "fa:16:3e:6f:03:66", "network": {"id": "21b08926-47cc-4bfc-9e0a-ce97c7914ba8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1692679468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b181392922e741a784b8a0d59ca79f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cfb5bf-92", "ovs_interfaceid": "83cfb5bf-92c3-4c75-b57f-0ad3382eb92a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_vif [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83cfb5bf-92, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:35 user nova-compute[82009]: INFO os_vif [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:03:66,bridge_name='br-int',has_traffic_filtering=True,id=83cfb5bf-92c3-4c75-b57f-0ad3382eb92a,network=Network(21b08926-47cc-4bfc-9e0a-ce97c7914ba8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cfb5bf-92')
Apr 11 18:12:35 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Deleting instance files /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a_del
Apr 11 18:12:35 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Deletion of /opt/stack/data/nova/instances/67cf8e45-399b-4709-a994-15daf849132a_del complete
Apr 11 18:12:35 user nova-compute[82009]: INFO nova.compute.manager [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:35 user nova-compute[82009]: INFO nova.compute.manager [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Attaching volume 4420439e-98b5-4fb2-96c9-d2d63151998d to /dev/vdb
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 807403520 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_brick.utils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc9e2c-8591-4d4c-b85a-00c0db78934c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d354782-974d-4395-bdfd-50a6e79e78e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29854c3-637f-40a4-a142-0316471249a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd96e5-8fe6-4062-a6b9-33f1c9808948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:35 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:12:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[908d672c-8244-404f-844d-91a92f5cd880]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG os_brick.utils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating existing volume attachment record: cb7d8388-ac9b-4af3-94d1-28e1c6d7081d {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:12:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 968884224 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.compute.manager [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.compute.manager [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:36 user nova-compute[82009]: WARNING nova.compute.manager [req-fb14a0a3-e493-4526-81fb-2b1a13266359 req-834df1a1-25f3-48df-b02b-77852ce68eec service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 for instance with vm_state active and task_state None.
Apr 11 18:12:36 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Took 1.21 seconds to deallocate network for instance.
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:36 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be7223f-a358-4ebe-803a-19f9ec936cba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:36 user nova-compute[82009]: No targets found.
Apr 11 18:12:36 user nova-compute[82009]: iSNS:
Apr 11 18:12:36 user nova-compute[82009]: No targets found.
Apr 11 18:12:36 user nova-compute[82009]: STATIC:
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b
Apr 11 18:12:36 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:36 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:36 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:36 user nova-compute[82009]: No targets found.
Apr 11 18:12:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:36 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:36 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d05bd-a40e-47a0-b442-c7267e8da1aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0496d-6fb0-4713-aafa-5303f9ac8da0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6c21d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139'): ({'sdh'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Removing single pathed devices sdh {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b0e5b6-ffa5-4845-9ea8-f0f60ae2e9fe]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d437e-1619-4465-8947-b501cfd4a3e6]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Flushing IO for device /dev/sdh {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba619952-3ba5-4a6a-b19a-70679b825283]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6357db7-5284-4fac-ad7d-4f3724fbb125]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] SCSI volumes sdh have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b9723-ef31-49ba-ac40-283e893a3d51]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d487c6-308a-451e-8fa3-5f2ba42bbef8]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]
Apr 11 18:12:36 user nova-compute[82009]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b11fb8e-8593-4428-b279-340caf69272a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] <== disconnect_volume: return (370ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:36 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Deleted allocations for instance 67cf8e45-399b-4709-a994-15daf849132a
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjGCYXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'c107e5ac-af58-4702-aa62-253f3424c585', 'attached_at': '', 'detached_at': '', 'volume_id': '464a3453-7243-4090-9e1d-855d6921a83b', 'serial'} {{(pid=82009) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] swap_volume: removing Cinder connection for volume f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 {{(pid=82009) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 18:12:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-24dbedc7-5eff-4e90-925b-8e74eca15e77 tempest-AttachSCSIVolumeTestJSON-1972641769 tempest-AttachSCSIVolumeTestJSON-1972641769-project-member] Lock "67cf8e45-399b-4709-a994-15daf849132a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Acquiring lock "67cf8e45-399b-4709-a994-15daf849132a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] Lock "67cf8e45-399b-4709-a994-15daf849132a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] No waiting events found dispatching network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:37 user nova-compute[82009]: WARNING nova.compute.manager [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received unexpected event network-vif-plugged-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a for instance with vm_state deleted and task_state None.
Apr 11 18:12:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-f0145cee-5f02-4bb7-86aa-ff737b2c6b91 req-0396a052-b9a4-4b7b-845f-fe4f00605245 service nova] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Received event network-vif-deleted-83cfb5bf-92c3-4c75-b57f-0ad3382eb92a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] swap_volume: Updating volume f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "AjGCYXsL", "auth_password": "W1zhKVTAsX7agS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "464a3453-7243-4090-9e1d-855d6921a83b"}, "status": "reserved", "instance": "c107e5ac-af58-4702-aa62-253f3424c585", "attached_at": "", "detached_at": "", "volume_id": "464a3453-7243-4090-9e1d-855d6921a83b", "serial": "464a3453-7243-4090-9e1d-855d6921a83b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '464a3453-7243-4090-9e1d-855d6921a83b', 'no_device': None, 'attachment_id': '835ed833-cbec-4a32-981f-190ef3114a46'} {{(pid=82009) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 18:12:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b5d35e1-4c44-4660-a27b-6b15eaa330db tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.713s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG os_brick.utils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88f1ea-81d4-40d4-af37-e5818e4d8b70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9853039-c9ef-481f-b7eb-9a858fd9ff80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46fe555-ace3-4e20-8a37-afbc84d16709]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839c35f-5592-4822-a5ba-e91691e16516]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:12:38 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:12:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5849bb18-75e6-4096-8258-f6c33e31abf1]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:12:38 user nova-compute[82009]: DEBUG os_brick.utils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:38 user nova-compute[82009]: INFO nova.compute.manager [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Swapping volume 464a3453-7243-4090-9e1d-855d6921a83b for f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:12:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSDtZGqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:39 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:39 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:39 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:12:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6a4075-26e6-4ee1-a5ac-9e5b58347d36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:12:40 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b328f11-cae7-42c8-969a-5e7ebcd48c3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d] added
Apr 11 18:12:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceffb75d-2212-46c2-8e0e-f75a5e33d5e1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[244fd90d-f342-4492-b667-66f28ab44052]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TSDtZGqC {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TSDtZGqC" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a51b4dd-2c2b-43a8-acde-eec5e520c3ca]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TSDtZGqC'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aac3fea-9621-4554-a88b-8f637b416b5d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c3cd58-48fe-458c-90c2-42d922d912b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d650a-904c-4729-a20a-a97dc43cd9b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260]
Apr 11 18:12:40 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b1115-fd74-44b3-8fa8-3f6e5da4e09e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ba492-5d7c-44cf-b46a-1d0defcf0cda]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[985c1d03-475d-40d0-afcb-a74c834f5067]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSDtZGqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23566303437333866', 'path': '/dev/sdh'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566303437333866', 'path': '/dev/sdh'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'flavor' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:12:41 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:41 user nova-compute[82009]:   <source dev="/dev/sdh"/>
Apr 11 18:12:41 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:41 user nova-compute[82009]:   <serial>4420439e-98b5-4fb2-96c9-d2d63151998d</serial>
Apr 11 18:12:41 user nova-compute[82009]: </disk>
Apr 11 18:12:41 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No BDM found with device name hda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:12:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] No VIF found with MAC fa:16:3e:b3:20:c6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd860b07-f0be-4140-a8c0-78c25b9c3555 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.726s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c107e5ac-af58-4702-aa62-253f3424c585', 'attached_at': '', 'detached_at': '', 'volume_id': 'f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'serial': 'f821ed7e-c1a1-4b28-a3da-7e2ce97b4139'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjGCYXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '464a3453-7243-4090-9e1d-855d6921a83b'}, 'status': 'reserved', 'instance': 'c107e5ac-af58-4702-aa62-253f3424c585', 'attached_at': '', 'detached_at': '', 'volume_id': '464a3453-7243-4090-9e1d-855d6921a83b', 'serial'} {{(pid=82009) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:42 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:42 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:42 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[da630f19-e5e5-47e8-913e-8b5be7b0b776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:12:42 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f7f61-f3ba-42bb-8d05-5e76156f5a7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139] added
Apr 11 18:12:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b54e976-4631-4585-973a-e680aa0c4394]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5834ea0-e296-4520-9d2d-b39b708571ea]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOvpAUnI {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOvpAUnI" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcd9d68-edcd-41b9-92ff-4e6eecad136b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOvpAUnI'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bff04c-78da-4eb5-8bfb-9c658ec5ee1c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eee3580-4135-4678-977b-8e4a55e5f243]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8fcd6e-894a-45ff-9840-cda71df40f47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]
Apr 11 18:12:43 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3706b8c6-023c-4867-b616-4263921fad10]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec1f7d9-d8ce-4dbc-94b4-04da38b96305]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ba80e-1aef-4052-ad9d-5251b55d3551]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:43 user nova-compute[82009]: INFO nova.compute.manager [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Detaching volume 4420439e-98b5-4fb2-96c9-d2d63151998d
Apr 11 18:12:43 user nova-compute[82009]: INFO nova.virt.block_device [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Attempting to driver detach volume 4420439e-98b5-4fb2-96c9-d2d63151998d from mountpoint /dev/vdb
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Attempting to detach device vdb from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:12:43 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:43 user nova-compute[82009]:   <source dev="/dev/sdh"/>
Apr 11 18:12:43 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:43 user nova-compute[82009]:   <serial>4420439e-98b5-4fb2-96c9-d2d63151998d</serial>
Apr 11 18:12:43 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 18:12:43 user nova-compute[82009]: </disk>
Apr 11 18:12:43 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully detached device vdb from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the persistent domain config.
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:12:43 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:43 user nova-compute[82009]:   <source dev="/dev/sdh"/>
Apr 11 18:12:43 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:43 user nova-compute[82009]:   <serial>4420439e-98b5-4fb2-96c9-d2d63151998d</serial>
Apr 11 18:12:43 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 18:12:43 user nova-compute[82009]: </disk>
Apr 11 18:12:43 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236763.9441085, 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:12:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully detached device vdb from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the live domain config.
Apr 11 18:12:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSDtZGqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:43 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23333623866343833', 'path': '/dev/sdi'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333623866343833', 'path': '/dev/sdi'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.235s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG nova.objects.instance [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lazy-loading 'flavor' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de568f3d-a30e-4c07-95d2-3937b10cf433]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:44 user nova-compute[82009]: No targets found.
Apr 11 18:12:44 user nova-compute[82009]: iSNS:
Apr 11 18:12:44 user nova-compute[82009]: No targets found.
Apr 11 18:12:44 user nova-compute[82009]: STATIC:
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d
Apr 11 18:12:44 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:44 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:44 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:44 user nova-compute[82009]: No targets found.
Apr 11 18:12:44 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:44 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:44 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce15b4-31bf-49d2-b8f5-e0be92bd6d66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75a3bab-91c1-4af8-92ca-596d3ad4f22c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:44 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6c23c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d'): ({'sdh'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Removing single pathed devices sdh {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[01176b15-cc24-4c3d-afa3-e488860d87b3]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c454185b-bab2-4538-8f30-00fe36073c6d]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Flushing IO for device /dev/sdh {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9f71c4-1bbc-4851-a144-af2a59b20cfb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c68382c-c2b7-41d9-906c-7117851c1149]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] SCSI volumes sdh have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b230f17d-0306-4ea6-a6fa-abb02757530b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb8ff5-c089-4a51-a01a-708f061122bc]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260]
Apr 11 18:12:44 user nova-compute[82009]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:44 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4420439e-98b5-4fb2-96c9-d2d63151998d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a738d6c-3674-4361-b8c5-f1a93c11071a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] <== disconnect_volume: return (578ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 124780544 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 287309824 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:45 user nova-compute[82009]: DEBUG nova.objects.instance [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'flavor' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5810b068-4eb5-496e-a985-92bb2532555c tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.591s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 455081984 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 641728512 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "interface-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-5a748b88-931b-4127-848e-b4f2255cd805" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "interface-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-5a748b88-931b-4127-848e-b4f2255cd805" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.objects.instance [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'flavor' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface> {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface> {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Attempting to detach device tap5a748b88-93 from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] detach device xml: <interface type="ethernet">
Apr 11 18:12:46 user nova-compute[82009]:   <mac address="fa:16:3e:f4:13:d8"/>
Apr 11 18:12:46 user nova-compute[82009]:   <model type="virtio"/>
Apr 11 18:12:46 user nova-compute[82009]:   <mtu size="1442"/>
Apr 11 18:12:46 user nova-compute[82009]:   <target dev="tap5a748b88-93"/>
Apr 11 18:12:46 user nova-compute[82009]: </interface>
Apr 11 18:12:46 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface> {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 18:12:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 11 18:12:46 user nova-compute[82009]:   <name>instance-00000009</name>
Apr 11 18:12:46 user nova-compute[82009]:   <uuid>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</uuid>
Apr 11 18:12:46 user nova-compute[82009]:   <metadata>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:46 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:46 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:46 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:34</nova:creationTime>
Apr 11 18:12:46 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:46 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:46 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:46 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:46 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:46 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:46 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:46 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:46 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:46 user nova-compute[82009]:     <nova:port uuid="5a748b88-931b-4127-848e-b4f2255cd805">
Apr 11 18:12:46 user nova-compute[82009]:       <nova:ip type="fixed" address="10.10.10.146" ipVersion="4"/>
Apr 11 18:12:46 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:46 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:46 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:46 user nova-compute[82009]:   </metadata>
Apr 11 18:12:46 user nova-compute[82009]:   <memory unit='KiB'>131072</memory>
Apr 11 18:12:46 user nova-compute[82009]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 18:12:46 user nova-compute[82009]:   <vcpu placement='static'>1</vcpu>
Apr 11 18:12:46 user nova-compute[82009]:   <resource>
Apr 11 18:12:46 user nova-compute[82009]:     <partition>/machine</partition>
Apr 11 18:12:46 user nova-compute[82009]:   </resource>
Apr 11 18:12:46 user nova-compute[82009]:   <sysinfo type='smbios'>
Apr 11 18:12:46 user nova-compute[82009]:     <system>
Apr 11 18:12:46 user nova-compute[82009]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 18:12:46 user nova-compute[82009]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 18:12:46 user nova-compute[82009]:       <entry name='version'>0.0.0</entry>
Apr 11 18:12:46 user nova-compute[82009]:       <entry name='serial'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:46 user nova-compute[82009]:       <entry name='uuid'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:46 user nova-compute[82009]:       <entry name='family'>Virtual Machine</entry>
Apr 11 18:12:46 user nova-compute[82009]:     </system>
Apr 11 18:12:46 user nova-compute[82009]:   </sysinfo>
Apr 11 18:12:46 user nova-compute[82009]:   <os>
Apr 11 18:12:46 user nova-compute[82009]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 18:12:46 user nova-compute[82009]:     <boot dev='hd'/>
Apr 11 18:12:46 user nova-compute[82009]:     <smbios mode='sysinfo'/>
Apr 11 18:12:46 user nova-compute[82009]:   </os>
Apr 11 18:12:46 user nova-compute[82009]:   <features>
Apr 11 18:12:46 user nova-compute[82009]:     <acpi/>
Apr 11 18:12:46 user nova-compute[82009]:     <apic/>
Apr 11 18:12:46 user nova-compute[82009]:     <vmcoreinfo state='on'/>
Apr 11 18:12:46 user nova-compute[82009]:   </features>
Apr 11 18:12:46 user nova-compute[82009]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 18:12:46 user nova-compute[82009]:     <model fallback='forbid'>Nehalem</model>
Apr 11 18:12:46 user nova-compute[82009]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 18:12:46 user nova-compute[82009]:     <feature policy='require' name='vme'/>
Apr 11 18:12:46 user nova-compute[82009]:     <feature policy='require' name='x2apic'/>
Apr 11 18:12:46 user nova-compute[82009]:     <feature policy='require' name='hypervisor'/>
Apr 11 18:12:46 user nova-compute[82009]:   </cpu>
Apr 11 18:12:46 user nova-compute[82009]:   <clock offset='utc'>
Apr 11 18:12:46 user nova-compute[82009]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 18:12:46 user nova-compute[82009]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 18:12:46 user nova-compute[82009]:     <timer name='hpet' present='no'/>
Apr 11 18:12:46 user nova-compute[82009]:   </clock>
Apr 11 18:12:46 user nova-compute[82009]:   <on_poweroff>destroy</on_poweroff>
Apr 11 18:12:46 user nova-compute[82009]:   <on_reboot>restart</on_reboot>
Apr 11 18:12:46 user nova-compute[82009]:   <on_crash>destroy</on_crash>
Apr 11 18:12:46 user nova-compute[82009]:   <devices>
Apr 11 18:12:46 user nova-compute[82009]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 18:12:46 user nova-compute[82009]:     <disk type='file' device='disk'>
Apr 11 18:12:46 user nova-compute[82009]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 18:12:46 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk' index='2'/>
Apr 11 18:12:46 user nova-compute[82009]:       <backingStore type='file' index='3'>
Apr 11 18:12:46 user nova-compute[82009]:         <format type='raw'/>
Apr 11 18:12:46 user nova-compute[82009]:         <source file='/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585'/>
Apr 11 18:12:46 user nova-compute[82009]:         <backingStore/>
Apr 11 18:12:46 user nova-compute[82009]:       </backingStore>
Apr 11 18:12:46 user nova-compute[82009]:       <target dev='vda' bus='virtio'/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='virtio-disk0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </disk>
Apr 11 18:12:46 user nova-compute[82009]:     <disk type='file' device='cdrom'>
Apr 11 18:12:46 user nova-compute[82009]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 18:12:46 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config' index='1'/>
Apr 11 18:12:46 user nova-compute[82009]:       <backingStore/>
Apr 11 18:12:46 user nova-compute[82009]:       <target dev='hda' bus='ide'/>
Apr 11 18:12:46 user nova-compute[82009]:       <readonly/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='ide0-0-0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </disk>
Apr 11 18:12:46 user nova-compute[82009]:     <controller type='usb' index='0' model='none'>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='usb'/>
Apr 11 18:12:46 user nova-compute[82009]:     </controller>
Apr 11 18:12:46 user nova-compute[82009]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='pci.0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </controller>
Apr 11 18:12:46 user nova-compute[82009]:     <controller type='ide' index='0'>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='ide'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 18:12:46 user nova-compute[82009]:     </controller>
Apr 11 18:12:46 user nova-compute[82009]:     <interface type='ethernet'>
Apr 11 18:12:46 user nova-compute[82009]:       <mac address='fa:16:3e:b3:20:c6'/>
Apr 11 18:12:46 user nova-compute[82009]:       <target dev='tap8967a8d4-b6'/>
Apr 11 18:12:46 user nova-compute[82009]:       <model type='virtio'/>
Apr 11 18:12:46 user nova-compute[82009]:       <mtu size='1442'/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='net0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </interface>
Apr 11 18:12:46 user nova-compute[82009]:     <interface type='ethernet'>
Apr 11 18:12:46 user nova-compute[82009]:       <mac address='fa:16:3e:f4:13:d8'/>
Apr 11 18:12:46 user nova-compute[82009]:       <target dev='tap5a748b88-93'/>
Apr 11 18:12:46 user nova-compute[82009]:       <model type='virtio'/>
Apr 11 18:12:46 user nova-compute[82009]:       <mtu size='1442'/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='net1'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </interface>
Apr 11 18:12:46 user nova-compute[82009]:     <serial type='pty'>
Apr 11 18:12:46 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:46 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:46 user nova-compute[82009]:       <target type='isa-serial' port='0'>
Apr 11 18:12:46 user nova-compute[82009]:         <model name='isa-serial'/>
Apr 11 18:12:46 user nova-compute[82009]:       </target>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </serial>
Apr 11 18:12:46 user nova-compute[82009]:     <console type='pty' tty='/dev/pts/8'>
Apr 11 18:12:46 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:46 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:46 user nova-compute[82009]:       <target type='serial' port='0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </console>
Apr 11 18:12:46 user nova-compute[82009]:     <input type='mouse' bus='ps2'>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='input0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </input>
Apr 11 18:12:46 user nova-compute[82009]:     <input type='keyboard' bus='ps2'>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='input1'/>
Apr 11 18:12:46 user nova-compute[82009]:     </input>
Apr 11 18:12:46 user nova-compute[82009]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 11 18:12:46 user nova-compute[82009]:       <listen type='address' address='0.0.0.0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </graphics>
Apr 11 18:12:46 user nova-compute[82009]:     <audio id='1' type='none'/>
Apr 11 18:12:46 user nova-compute[82009]:     <video>
Apr 11 18:12:46 user nova-compute[82009]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='video0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </video>
Apr 11 18:12:46 user nova-compute[82009]:     <memballoon model='virtio'>
Apr 11 18:12:46 user nova-compute[82009]:       <stats period='10'/>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='balloon0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </memballoon>
Apr 11 18:12:46 user nova-compute[82009]:     <rng model='virtio'>
Apr 11 18:12:46 user nova-compute[82009]:       <backend model='random'>/dev/urandom</backend>
Apr 11 18:12:46 user nova-compute[82009]:       <alias name='rng0'/>
Apr 11 18:12:46 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 18:12:46 user nova-compute[82009]:     </rng>
Apr 11 18:12:46 user nova-compute[82009]:   </devices>
Apr 11 18:12:46 user nova-compute[82009]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 18:12:46 user nova-compute[82009]:     <label>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</label>
Apr 11 18:12:46 user nova-compute[82009]:     <imagelabel>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</imagelabel>
Apr 11 18:12:46 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:46 user nova-compute[82009]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 18:12:46 user nova-compute[82009]:     <label>+64055:+108</label>
Apr 11 18:12:46 user nova-compute[82009]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 18:12:46 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:46 user nova-compute[82009]: </domain>
Apr 11 18:12:46 user nova-compute[82009]:  {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 18:12:47 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully detached device tap5a748b88-93 from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the persistent domain config.
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] (1/8): Attempting to detach device tap5a748b88-93 with device alias net1 from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] detach device xml: <interface type="ethernet">
Apr 11 18:12:47 user nova-compute[82009]:   <mac address="fa:16:3e:f4:13:d8"/>
Apr 11 18:12:47 user nova-compute[82009]:   <model type="virtio"/>
Apr 11 18:12:47 user nova-compute[82009]:   <mtu size="1442"/>
Apr 11 18:12:47 user nova-compute[82009]:   <target dev="tap5a748b88-93"/>
Apr 11 18:12:47 user nova-compute[82009]: </interface>
Apr 11 18:12:47 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 805306368 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236767.305785, 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Start waiting for the detach event from libvirt for device tap5a748b88-93 with device alias net1 for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface> {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 11 18:12:47 user nova-compute[82009]:   <name>instance-00000009</name>
Apr 11 18:12:47 user nova-compute[82009]:   <uuid>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</uuid>
Apr 11 18:12:47 user nova-compute[82009]:   <metadata>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:47 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:34</nova:creationTime>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:47 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:47 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:47 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:47 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:47 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:port uuid="5a748b88-931b-4127-848e-b4f2255cd805">
Apr 11 18:12:47 user nova-compute[82009]:       <nova:ip type="fixed" address="10.10.10.146" ipVersion="4"/>
Apr 11 18:12:47 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:47 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:47 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:47 user nova-compute[82009]:   </metadata>
Apr 11 18:12:47 user nova-compute[82009]:   <memory unit='KiB'>131072</memory>
Apr 11 18:12:47 user nova-compute[82009]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 18:12:47 user nova-compute[82009]:   <vcpu placement='static'>1</vcpu>
Apr 11 18:12:47 user nova-compute[82009]:   <resource>
Apr 11 18:12:47 user nova-compute[82009]:     <partition>/machine</partition>
Apr 11 18:12:47 user nova-compute[82009]:   </resource>
Apr 11 18:12:47 user nova-compute[82009]:   <sysinfo type='smbios'>
Apr 11 18:12:47 user nova-compute[82009]:     <system>
Apr 11 18:12:47 user nova-compute[82009]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 18:12:47 user nova-compute[82009]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 18:12:47 user nova-compute[82009]:       <entry name='version'>0.0.0</entry>
Apr 11 18:12:47 user nova-compute[82009]:       <entry name='serial'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:47 user nova-compute[82009]:       <entry name='uuid'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:47 user nova-compute[82009]:       <entry name='family'>Virtual Machine</entry>
Apr 11 18:12:47 user nova-compute[82009]:     </system>
Apr 11 18:12:47 user nova-compute[82009]:   </sysinfo>
Apr 11 18:12:47 user nova-compute[82009]:   <os>
Apr 11 18:12:47 user nova-compute[82009]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 18:12:47 user nova-compute[82009]:     <boot dev='hd'/>
Apr 11 18:12:47 user nova-compute[82009]:     <smbios mode='sysinfo'/>
Apr 11 18:12:47 user nova-compute[82009]:   </os>
Apr 11 18:12:47 user nova-compute[82009]:   <features>
Apr 11 18:12:47 user nova-compute[82009]:     <acpi/>
Apr 11 18:12:47 user nova-compute[82009]:     <apic/>
Apr 11 18:12:47 user nova-compute[82009]:     <vmcoreinfo state='on'/>
Apr 11 18:12:47 user nova-compute[82009]:   </features>
Apr 11 18:12:47 user nova-compute[82009]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 18:12:47 user nova-compute[82009]:     <model fallback='forbid'>Nehalem</model>
Apr 11 18:12:47 user nova-compute[82009]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 18:12:47 user nova-compute[82009]:     <feature policy='require' name='vme'/>
Apr 11 18:12:47 user nova-compute[82009]:     <feature policy='require' name='x2apic'/>
Apr 11 18:12:47 user nova-compute[82009]:     <feature policy='require' name='hypervisor'/>
Apr 11 18:12:47 user nova-compute[82009]:   </cpu>
Apr 11 18:12:47 user nova-compute[82009]:   <clock offset='utc'>
Apr 11 18:12:47 user nova-compute[82009]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 18:12:47 user nova-compute[82009]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 18:12:47 user nova-compute[82009]:     <timer name='hpet' present='no'/>
Apr 11 18:12:47 user nova-compute[82009]:   </clock>
Apr 11 18:12:47 user nova-compute[82009]:   <on_poweroff>destroy</on_poweroff>
Apr 11 18:12:47 user nova-compute[82009]:   <on_reboot>restart</on_reboot>
Apr 11 18:12:47 user nova-compute[82009]:   <on_crash>destroy</on_crash>
Apr 11 18:12:47 user nova-compute[82009]:   <devices>
Apr 11 18:12:47 user nova-compute[82009]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 18:12:47 user nova-compute[82009]:     <disk type='file' device='disk'>
Apr 11 18:12:47 user nova-compute[82009]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 18:12:47 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk' index='2'/>
Apr 11 18:12:47 user nova-compute[82009]:       <backingStore type='file' index='3'>
Apr 11 18:12:47 user nova-compute[82009]:         <format type='raw'/>
Apr 11 18:12:47 user nova-compute[82009]:         <source file='/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585'/>
Apr 11 18:12:47 user nova-compute[82009]:         <backingStore/>
Apr 11 18:12:47 user nova-compute[82009]:       </backingStore>
Apr 11 18:12:47 user nova-compute[82009]:       <target dev='vda' bus='virtio'/>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='virtio-disk0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </disk>
Apr 11 18:12:47 user nova-compute[82009]:     <disk type='file' device='cdrom'>
Apr 11 18:12:47 user nova-compute[82009]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 18:12:47 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config' index='1'/>
Apr 11 18:12:47 user nova-compute[82009]:       <backingStore/>
Apr 11 18:12:47 user nova-compute[82009]:       <target dev='hda' bus='ide'/>
Apr 11 18:12:47 user nova-compute[82009]:       <readonly/>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='ide0-0-0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </disk>
Apr 11 18:12:47 user nova-compute[82009]:     <controller type='usb' index='0' model='none'>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='usb'/>
Apr 11 18:12:47 user nova-compute[82009]:     </controller>
Apr 11 18:12:47 user nova-compute[82009]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='pci.0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </controller>
Apr 11 18:12:47 user nova-compute[82009]:     <controller type='ide' index='0'>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='ide'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 18:12:47 user nova-compute[82009]:     </controller>
Apr 11 18:12:47 user nova-compute[82009]:     <interface type='ethernet'>
Apr 11 18:12:47 user nova-compute[82009]:       <mac address='fa:16:3e:b3:20:c6'/>
Apr 11 18:12:47 user nova-compute[82009]:       <target dev='tap8967a8d4-b6'/>
Apr 11 18:12:47 user nova-compute[82009]:       <model type='virtio'/>
Apr 11 18:12:47 user nova-compute[82009]:       <mtu size='1442'/>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='net0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </interface>
Apr 11 18:12:47 user nova-compute[82009]:     <serial type='pty'>
Apr 11 18:12:47 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:47 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:47 user nova-compute[82009]:       <target type='isa-serial' port='0'>
Apr 11 18:12:47 user nova-compute[82009]:         <model name='isa-serial'/>
Apr 11 18:12:47 user nova-compute[82009]:       </target>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </serial>
Apr 11 18:12:47 user nova-compute[82009]:     <console type='pty' tty='/dev/pts/8'>
Apr 11 18:12:47 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:47 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:47 user nova-compute[82009]:       <target type='serial' port='0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </console>
Apr 11 18:12:47 user nova-compute[82009]:     <input type='mouse' bus='ps2'>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='input0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </input>
Apr 11 18:12:47 user nova-compute[82009]:     <input type='keyboard' bus='ps2'>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='input1'/>
Apr 11 18:12:47 user nova-compute[82009]:     </input>
Apr 11 18:12:47 user nova-compute[82009]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 11 18:12:47 user nova-compute[82009]:       <listen type='address' address='0.0.0.0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </graphics>
Apr 11 18:12:47 user nova-compute[82009]:     <audio id='1' type='none'/>
Apr 11 18:12:47 user nova-compute[82009]:     <video>
Apr 11 18:12:47 user nova-compute[82009]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='video0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </video>
Apr 11 18:12:47 user nova-compute[82009]:     <memballoon model='virtio'>
Apr 11 18:12:47 user nova-compute[82009]:       <stats period='10'/>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='balloon0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </memballoon>
Apr 11 18:12:47 user nova-compute[82009]:     <rng model='virtio'>
Apr 11 18:12:47 user nova-compute[82009]:       <backend model='random'>/dev/urandom</backend>
Apr 11 18:12:47 user nova-compute[82009]:       <alias name='rng0'/>
Apr 11 18:12:47 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 18:12:47 user nova-compute[82009]:     </rng>
Apr 11 18:12:47 user nova-compute[82009]:   </devices>
Apr 11 18:12:47 user nova-compute[82009]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 18:12:47 user nova-compute[82009]:     <label>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</label>
Apr 11 18:12:47 user nova-compute[82009]:     <imagelabel>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</imagelabel>
Apr 11 18:12:47 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:47 user nova-compute[82009]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 18:12:47 user nova-compute[82009]:     <label>+64055:+108</label>
Apr 11 18:12:47 user nova-compute[82009]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 18:12:47 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:47 user nova-compute[82009]: </domain>
Apr 11 18:12:47 user nova-compute[82009]:  {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 18:12:47 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully detached device tap5a748b88-93 from instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b from the live domain config.
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG os_vif [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a748b88-93, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:47 user nova-compute[82009]: INFO os_vif [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93')
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:47 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:47</nova:creationTime>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:47 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:47 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:47 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:47 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:47 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:47 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:47 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:47 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:47 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:47 user nova-compute[82009]:  {{(pid=82009) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-unplugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-unplugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:47 user nova-compute[82009]: WARNING nova.compute.manager [req-0936f3cc-e3b2-4093-80ff-962e453b8f43 req-1a94370e-9026-4da3-b2e0-26362c93026f service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-unplugged-5a748b88-931b-4127-848e-b4f2255cd805 for instance with vm_state active and task_state None.
Apr 11 18:12:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 958398464 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjGCYXsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '464a3453-7243-4090-9e1d-855d6921a83b': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:48 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82074d1-2c7f-46a8-a5cb-5b340c644531]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:48 user nova-compute[82009]: No targets found.
Apr 11 18:12:48 user nova-compute[82009]: iSNS:
Apr 11 18:12:48 user nova-compute[82009]: No targets found.
Apr 11 18:12:48 user nova-compute[82009]: STATIC:
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b
Apr 11 18:12:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:48 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:48 user nova-compute[82009]: No targets found.
Apr 11 18:12:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:48 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:48 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c20c941-b82a-406c-842f-a390ac5f8065]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a644f4-520f-4237-bdf4-cce563ef90cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e4a20ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b'): ({'sdj'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Removing single pathed devices sdj {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b013340-22db-47ae-8ca7-65dbea7e7ec8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5c068-2bd4-407b-a7a6-18c573752182]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Flushing IO for device /dev/sdj {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623f016-d7ff-462c-87a9-e3b2a4f42b9b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.061s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c990f583-6ce6-4eba-aa50-fa7efbaa3b51]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] SCSI volumes sdj have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a0c61-ee90-45ca-972a-c2cca60225b6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b811ab6-b3d2-460d-8473-1a940d4bbbe1]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260]
Apr 11 18:12:48 user nova-compute[82009]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:464a3453-7243-4090-9e1d-855d6921a83b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b3626-512f-42ec-a4f3-e17ba10f169a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] <== disconnect_volume: return (421ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-deleted-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:48 user nova-compute[82009]: INFO nova.compute.manager [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Neutron deleted interface 5a748b88-931b-4127-848e-b4f2255cd805; detaching it from the instance and deleting it from the info cache
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.network.neutron [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'c107e5ac-af58-4702-aa62-253f3424c585', 'attached_at': '', 'detached_at': '', 'volume_id': 'f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'serial'} {{(pid=82009) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] swap_volume: removing Cinder connection for volume 464a3453-7243-4090-9e1d-855d6921a83b {{(pid=82009) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquired lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.objects.instance [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Lazy-loading 'system_metadata' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.objects.instance [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Lazy-loading 'flavor' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Converting VIF {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface> {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 11 18:12:48 user nova-compute[82009]:   <name>instance-00000009</name>
Apr 11 18:12:48 user nova-compute[82009]:   <uuid>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</uuid>
Apr 11 18:12:48 user nova-compute[82009]:   <metadata>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:48 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:47</nova:creationTime>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:48 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:48 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:48 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:48 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:48 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:48 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:48 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:48 user nova-compute[82009]:   </metadata>
Apr 11 18:12:48 user nova-compute[82009]:   <memory unit='KiB'>131072</memory>
Apr 11 18:12:48 user nova-compute[82009]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 18:12:48 user nova-compute[82009]:   <vcpu placement='static'>1</vcpu>
Apr 11 18:12:48 user nova-compute[82009]:   <resource>
Apr 11 18:12:48 user nova-compute[82009]:     <partition>/machine</partition>
Apr 11 18:12:48 user nova-compute[82009]:   </resource>
Apr 11 18:12:48 user nova-compute[82009]:   <sysinfo type='smbios'>
Apr 11 18:12:48 user nova-compute[82009]:     <system>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='version'>0.0.0</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='serial'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='uuid'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='family'>Virtual Machine</entry>
Apr 11 18:12:48 user nova-compute[82009]:     </system>
Apr 11 18:12:48 user nova-compute[82009]:   </sysinfo>
Apr 11 18:12:48 user nova-compute[82009]:   <os>
Apr 11 18:12:48 user nova-compute[82009]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 18:12:48 user nova-compute[82009]:     <boot dev='hd'/>
Apr 11 18:12:48 user nova-compute[82009]:     <smbios mode='sysinfo'/>
Apr 11 18:12:48 user nova-compute[82009]:   </os>
Apr 11 18:12:48 user nova-compute[82009]:   <features>
Apr 11 18:12:48 user nova-compute[82009]:     <acpi/>
Apr 11 18:12:48 user nova-compute[82009]:     <apic/>
Apr 11 18:12:48 user nova-compute[82009]:     <vmcoreinfo state='on'/>
Apr 11 18:12:48 user nova-compute[82009]:   </features>
Apr 11 18:12:48 user nova-compute[82009]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 18:12:48 user nova-compute[82009]:     <model fallback='forbid'>Nehalem</model>
Apr 11 18:12:48 user nova-compute[82009]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 18:12:48 user nova-compute[82009]:     <feature policy='require' name='vme'/>
Apr 11 18:12:48 user nova-compute[82009]:     <feature policy='require' name='x2apic'/>
Apr 11 18:12:48 user nova-compute[82009]:     <feature policy='require' name='hypervisor'/>
Apr 11 18:12:48 user nova-compute[82009]:   </cpu>
Apr 11 18:12:48 user nova-compute[82009]:   <clock offset='utc'>
Apr 11 18:12:48 user nova-compute[82009]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 18:12:48 user nova-compute[82009]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 18:12:48 user nova-compute[82009]:     <timer name='hpet' present='no'/>
Apr 11 18:12:48 user nova-compute[82009]:   </clock>
Apr 11 18:12:48 user nova-compute[82009]:   <on_poweroff>destroy</on_poweroff>
Apr 11 18:12:48 user nova-compute[82009]:   <on_reboot>restart</on_reboot>
Apr 11 18:12:48 user nova-compute[82009]:   <on_crash>destroy</on_crash>
Apr 11 18:12:48 user nova-compute[82009]:   <devices>
Apr 11 18:12:48 user nova-compute[82009]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 18:12:48 user nova-compute[82009]:     <disk type='file' device='disk'>
Apr 11 18:12:48 user nova-compute[82009]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 18:12:48 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk' index='2'/>
Apr 11 18:12:48 user nova-compute[82009]:       <backingStore type='file' index='3'>
Apr 11 18:12:48 user nova-compute[82009]:         <format type='raw'/>
Apr 11 18:12:48 user nova-compute[82009]:         <source file='/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585'/>
Apr 11 18:12:48 user nova-compute[82009]:         <backingStore/>
Apr 11 18:12:48 user nova-compute[82009]:       </backingStore>
Apr 11 18:12:48 user nova-compute[82009]:       <target dev='vda' bus='virtio'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='virtio-disk0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </disk>
Apr 11 18:12:48 user nova-compute[82009]:     <disk type='file' device='cdrom'>
Apr 11 18:12:48 user nova-compute[82009]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 18:12:48 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config' index='1'/>
Apr 11 18:12:48 user nova-compute[82009]:       <backingStore/>
Apr 11 18:12:48 user nova-compute[82009]:       <target dev='hda' bus='ide'/>
Apr 11 18:12:48 user nova-compute[82009]:       <readonly/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='ide0-0-0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </disk>
Apr 11 18:12:48 user nova-compute[82009]:     <controller type='usb' index='0' model='none'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='usb'/>
Apr 11 18:12:48 user nova-compute[82009]:     </controller>
Apr 11 18:12:48 user nova-compute[82009]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='pci.0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </controller>
Apr 11 18:12:48 user nova-compute[82009]:     <controller type='ide' index='0'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='ide'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 18:12:48 user nova-compute[82009]:     </controller>
Apr 11 18:12:48 user nova-compute[82009]:     <interface type='ethernet'>
Apr 11 18:12:48 user nova-compute[82009]:       <mac address='fa:16:3e:b3:20:c6'/>
Apr 11 18:12:48 user nova-compute[82009]:       <target dev='tap8967a8d4-b6'/>
Apr 11 18:12:48 user nova-compute[82009]:       <model type='virtio'/>
Apr 11 18:12:48 user nova-compute[82009]:       <mtu size='1442'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='net0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </interface>
Apr 11 18:12:48 user nova-compute[82009]:     <serial type='pty'>
Apr 11 18:12:48 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:48 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:48 user nova-compute[82009]:       <target type='isa-serial' port='0'>
Apr 11 18:12:48 user nova-compute[82009]:         <model name='isa-serial'/>
Apr 11 18:12:48 user nova-compute[82009]:       </target>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </serial>
Apr 11 18:12:48 user nova-compute[82009]:     <console type='pty' tty='/dev/pts/8'>
Apr 11 18:12:48 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:48 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:48 user nova-compute[82009]:       <target type='serial' port='0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </console>
Apr 11 18:12:48 user nova-compute[82009]:     <input type='mouse' bus='ps2'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='input0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </input>
Apr 11 18:12:48 user nova-compute[82009]:     <input type='keyboard' bus='ps2'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='input1'/>
Apr 11 18:12:48 user nova-compute[82009]:     </input>
Apr 11 18:12:48 user nova-compute[82009]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 11 18:12:48 user nova-compute[82009]:       <listen type='address' address='0.0.0.0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </graphics>
Apr 11 18:12:48 user nova-compute[82009]:     <audio id='1' type='none'/>
Apr 11 18:12:48 user nova-compute[82009]:     <video>
Apr 11 18:12:48 user nova-compute[82009]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='video0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </video>
Apr 11 18:12:48 user nova-compute[82009]:     <memballoon model='virtio'>
Apr 11 18:12:48 user nova-compute[82009]:       <stats period='10'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='balloon0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </memballoon>
Apr 11 18:12:48 user nova-compute[82009]:     <rng model='virtio'>
Apr 11 18:12:48 user nova-compute[82009]:       <backend model='random'>/dev/urandom</backend>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='rng0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </rng>
Apr 11 18:12:48 user nova-compute[82009]:   </devices>
Apr 11 18:12:48 user nova-compute[82009]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 18:12:48 user nova-compute[82009]:     <label>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</label>
Apr 11 18:12:48 user nova-compute[82009]:     <imagelabel>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</imagelabel>
Apr 11 18:12:48 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:48 user nova-compute[82009]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 18:12:48 user nova-compute[82009]:     <label>+64055:+108</label>
Apr 11 18:12:48 user nova-compute[82009]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 18:12:48 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:48 user nova-compute[82009]: </domain>
Apr 11 18:12:48 user nova-compute[82009]:  {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface> {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f4:13:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap5a748b88-93"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 11 18:12:48 user nova-compute[82009]:   <name>instance-00000009</name>
Apr 11 18:12:48 user nova-compute[82009]:   <uuid>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</uuid>
Apr 11 18:12:48 user nova-compute[82009]:   <metadata>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:48 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:47</nova:creationTime>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:48 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:48 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:48 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:48 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:48 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:48 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:48 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:48 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:48 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:48 user nova-compute[82009]:   </metadata>
Apr 11 18:12:48 user nova-compute[82009]:   <memory unit='KiB'>131072</memory>
Apr 11 18:12:48 user nova-compute[82009]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 18:12:48 user nova-compute[82009]:   <vcpu placement='static'>1</vcpu>
Apr 11 18:12:48 user nova-compute[82009]:   <resource>
Apr 11 18:12:48 user nova-compute[82009]:     <partition>/machine</partition>
Apr 11 18:12:48 user nova-compute[82009]:   </resource>
Apr 11 18:12:48 user nova-compute[82009]:   <sysinfo type='smbios'>
Apr 11 18:12:48 user nova-compute[82009]:     <system>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='version'>0.0.0</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='serial'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='uuid'>9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</entry>
Apr 11 18:12:48 user nova-compute[82009]:       <entry name='family'>Virtual Machine</entry>
Apr 11 18:12:48 user nova-compute[82009]:     </system>
Apr 11 18:12:48 user nova-compute[82009]:   </sysinfo>
Apr 11 18:12:48 user nova-compute[82009]:   <os>
Apr 11 18:12:48 user nova-compute[82009]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 18:12:48 user nova-compute[82009]:     <boot dev='hd'/>
Apr 11 18:12:48 user nova-compute[82009]:     <smbios mode='sysinfo'/>
Apr 11 18:12:48 user nova-compute[82009]:   </os>
Apr 11 18:12:48 user nova-compute[82009]:   <features>
Apr 11 18:12:48 user nova-compute[82009]:     <acpi/>
Apr 11 18:12:48 user nova-compute[82009]:     <apic/>
Apr 11 18:12:48 user nova-compute[82009]:     <vmcoreinfo state='on'/>
Apr 11 18:12:48 user nova-compute[82009]:   </features>
Apr 11 18:12:48 user nova-compute[82009]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 18:12:48 user nova-compute[82009]:     <model fallback='forbid'>Nehalem</model>
Apr 11 18:12:48 user nova-compute[82009]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 18:12:48 user nova-compute[82009]:     <feature policy='require' name='vme'/>
Apr 11 18:12:48 user nova-compute[82009]:     <feature policy='require' name='x2apic'/>
Apr 11 18:12:48 user nova-compute[82009]:     <feature policy='require' name='hypervisor'/>
Apr 11 18:12:48 user nova-compute[82009]:   </cpu>
Apr 11 18:12:48 user nova-compute[82009]:   <clock offset='utc'>
Apr 11 18:12:48 user nova-compute[82009]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 18:12:48 user nova-compute[82009]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 18:12:48 user nova-compute[82009]:     <timer name='hpet' present='no'/>
Apr 11 18:12:48 user nova-compute[82009]:   </clock>
Apr 11 18:12:48 user nova-compute[82009]:   <on_poweroff>destroy</on_poweroff>
Apr 11 18:12:48 user nova-compute[82009]:   <on_reboot>restart</on_reboot>
Apr 11 18:12:48 user nova-compute[82009]:   <on_crash>destroy</on_crash>
Apr 11 18:12:48 user nova-compute[82009]:   <devices>
Apr 11 18:12:48 user nova-compute[82009]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 18:12:48 user nova-compute[82009]:     <disk type='file' device='disk'>
Apr 11 18:12:48 user nova-compute[82009]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 18:12:48 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk' index='2'/>
Apr 11 18:12:48 user nova-compute[82009]:       <backingStore type='file' index='3'>
Apr 11 18:12:48 user nova-compute[82009]:         <format type='raw'/>
Apr 11 18:12:48 user nova-compute[82009]:         <source file='/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585'/>
Apr 11 18:12:48 user nova-compute[82009]:         <backingStore/>
Apr 11 18:12:48 user nova-compute[82009]:       </backingStore>
Apr 11 18:12:48 user nova-compute[82009]:       <target dev='vda' bus='virtio'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='virtio-disk0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </disk>
Apr 11 18:12:48 user nova-compute[82009]:     <disk type='file' device='cdrom'>
Apr 11 18:12:48 user nova-compute[82009]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 18:12:48 user nova-compute[82009]:       <source file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk.config' index='1'/>
Apr 11 18:12:48 user nova-compute[82009]:       <backingStore/>
Apr 11 18:12:48 user nova-compute[82009]:       <target dev='hda' bus='ide'/>
Apr 11 18:12:48 user nova-compute[82009]:       <readonly/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='ide0-0-0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </disk>
Apr 11 18:12:48 user nova-compute[82009]:     <controller type='usb' index='0' model='none'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='usb'/>
Apr 11 18:12:48 user nova-compute[82009]:     </controller>
Apr 11 18:12:48 user nova-compute[82009]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='pci.0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </controller>
Apr 11 18:12:48 user nova-compute[82009]:     <controller type='ide' index='0'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='ide'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 18:12:48 user nova-compute[82009]:     </controller>
Apr 11 18:12:48 user nova-compute[82009]:     <interface type='ethernet'>
Apr 11 18:12:48 user nova-compute[82009]:       <mac address='fa:16:3e:b3:20:c6'/>
Apr 11 18:12:48 user nova-compute[82009]:       <target dev='tap8967a8d4-b6'/>
Apr 11 18:12:48 user nova-compute[82009]:       <model type='virtio'/>
Apr 11 18:12:48 user nova-compute[82009]:       <mtu size='1442'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='net0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </interface>
Apr 11 18:12:48 user nova-compute[82009]:     <serial type='pty'>
Apr 11 18:12:48 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:48 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:48 user nova-compute[82009]:       <target type='isa-serial' port='0'>
Apr 11 18:12:48 user nova-compute[82009]:         <model name='isa-serial'/>
Apr 11 18:12:48 user nova-compute[82009]:       </target>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </serial>
Apr 11 18:12:48 user nova-compute[82009]:     <console type='pty' tty='/dev/pts/8'>
Apr 11 18:12:48 user nova-compute[82009]:       <source path='/dev/pts/8'/>
Apr 11 18:12:48 user nova-compute[82009]:       <log file='/opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/console.log' append='off'/>
Apr 11 18:12:48 user nova-compute[82009]:       <target type='serial' port='0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='serial0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </console>
Apr 11 18:12:48 user nova-compute[82009]:     <input type='mouse' bus='ps2'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='input0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </input>
Apr 11 18:12:48 user nova-compute[82009]:     <input type='keyboard' bus='ps2'>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='input1'/>
Apr 11 18:12:48 user nova-compute[82009]:     </input>
Apr 11 18:12:48 user nova-compute[82009]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 11 18:12:48 user nova-compute[82009]:       <listen type='address' address='0.0.0.0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </graphics>
Apr 11 18:12:48 user nova-compute[82009]:     <audio id='1' type='none'/>
Apr 11 18:12:48 user nova-compute[82009]:     <video>
Apr 11 18:12:48 user nova-compute[82009]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='video0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </video>
Apr 11 18:12:48 user nova-compute[82009]:     <memballoon model='virtio'>
Apr 11 18:12:48 user nova-compute[82009]:       <stats period='10'/>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='balloon0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </memballoon>
Apr 11 18:12:48 user nova-compute[82009]:     <rng model='virtio'>
Apr 11 18:12:48 user nova-compute[82009]:       <backend model='random'>/dev/urandom</backend>
Apr 11 18:12:48 user nova-compute[82009]:       <alias name='rng0'/>
Apr 11 18:12:48 user nova-compute[82009]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 18:12:48 user nova-compute[82009]:     </rng>
Apr 11 18:12:48 user nova-compute[82009]:   </devices>
Apr 11 18:12:48 user nova-compute[82009]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 18:12:48 user nova-compute[82009]:     <label>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</label>
Apr 11 18:12:48 user nova-compute[82009]:     <imagelabel>libvirt-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b</imagelabel>
Apr 11 18:12:48 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:48 user nova-compute[82009]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 18:12:48 user nova-compute[82009]:     <label>+64055:+108</label>
Apr 11 18:12:48 user nova-compute[82009]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 18:12:48 user nova-compute[82009]:   </seclabel>
Apr 11 18:12:48 user nova-compute[82009]: </domain>
Apr 11 18:12:48 user nova-compute[82009]:  {{(pid=82009) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 18:12:48 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Detaching interface fa:16:3e:f4:13:d8 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap5a748b88-93' not found.
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Converting VIF {"id": "5a748b88-931b-4127-848e-b4f2255cd805", "address": "fa:16:3e:f4:13:d8", "network": {"id": "ce4a6c46-caac-4472-b562-2a6cc6cfd925", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-332821470", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a748b88-93", "ovs_interfaceid": "5a748b88-931b-4127-848e-b4f2255cd805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG os_vif [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a748b88-93, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:12:49 user nova-compute[82009]: INFO os_vif [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:13:d8,bridge_name='br-int',has_traffic_filtering=True,id=5a748b88-931b-4127-848e-b4f2255cd805,network=Network(ce4a6c46-caac-4472-b562-2a6cc6cfd925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a748b88-93')
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [req-06ea66b1-4fbd-4768-a292-cf318fb895a4 req-e6c426ac-638c-4e2c-a277-28e5fe5a52b9 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:12:49 user nova-compute[82009]:   <nova:package version="0.0.0"/>
Apr 11 18:12:49 user nova-compute[82009]:   <nova:name>tempest-device-tagging-server-1489917956</nova:name>
Apr 11 18:12:49 user nova-compute[82009]:   <nova:creationTime>2023-04-11 18:12:48</nova:creationTime>
Apr 11 18:12:49 user nova-compute[82009]:   <nova:flavor name="m1.nano">
Apr 11 18:12:49 user nova-compute[82009]:     <nova:memory>128</nova:memory>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:disk>1</nova:disk>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:swap>0</nova:swap>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:vcpus>1</nova:vcpus>
Apr 11 18:12:49 user nova-compute[82009]:   </nova:flavor>
Apr 11 18:12:49 user nova-compute[82009]:   <nova:owner>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:user uuid="d70760a1251b4629afcc8c80ae00c659">tempest-TaggedAttachmentsTest-915024626-project-member</nova:user>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:project uuid="9376efafce66467aa4efde41acbce713">tempest-TaggedAttachmentsTest-915024626</nova:project>
Apr 11 18:12:49 user nova-compute[82009]:   </nova:owner>
Apr 11 18:12:49 user nova-compute[82009]:   <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:12:49 user nova-compute[82009]:   <nova:ports>
Apr 11 18:12:49 user nova-compute[82009]:     <nova:port uuid="8967a8d4-b607-4572-bfc2-50c7663563cb">
Apr 11 18:12:49 user nova-compute[82009]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:12:49 user nova-compute[82009]:     </nova:port>
Apr 11 18:12:49 user nova-compute[82009]:   </nova:ports>
Apr 11 18:12:49 user nova-compute[82009]: </nova:instance>
Apr 11 18:12:49 user nova-compute[82009]:  {{(pid=82009) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-changed-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing instance network info cache due to event network-changed-8e9ebc37-3669-4688-97c5-f3ff04bc51e3. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Acquiring lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Acquired lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Refreshing network info cache for port 8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [{"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] [instance: c107e5ac-af58-4702-aa62-253f3424c585] swap_volume: Updating volume 464a3453-7243-4090-9e1d-855d6921a83b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dOvpAUnI", "auth_password": "TkO2Mp8NmYv1qj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "f821ed7e-c1a1-4b28-a3da-7e2ce97b4139"}, "status": "reserved", "instance": "c107e5ac-af58-4702-aa62-253f3424c585", "attached_at": "", "detached_at": "", "volume_id": "f821ed7e-c1a1-4b28-a3da-7e2ce97b4139", "serial": "f821ed7e-c1a1-4b28-a3da-7e2ce97b4139"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'no_device': None, 'attachment_id': '9e24dacf-ecc7-4624-9d6e-fe3cb59af957'} {{(pid=82009) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updated VIF entry in instance network info cache for port 8e9ebc37-3669-4688-97c5-f3ff04bc51e3. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Releasing lock "refresh_cache-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4a9852f7-87b3-4635-89ca-aa3d3f4356be tempest-TestVolumeSwap-286310285 tempest-TestVolumeSwap-286310285-project-admin] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.308s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d2530a31-24c1-4619-b135-8a578db9e08c req-9a92d868-d426-44d8-b323-67e2610def49 service nova] Releasing lock "refresh_cache-3aedb5f4-32cf-497c-8035-0f694cbf78cf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:49 user nova-compute[82009]: WARNING nova.compute.manager [req-505a5cc9-760e-476f-8f99-9bc4f9941706 req-2d76800f-84db-47be-a6de-a6a6e09eb961 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-plugged-5a748b88-931b-4127-848e-b4f2255cd805 for instance with vm_state active and task_state None.
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b172b173-c625-4790-83d4-954500dda9a6 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "interface-9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-5a748b88-931b-4127-848e-b4f2255cd805" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.898s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:12:49 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236754.9937246, 67cf8e45-399b-4709-a994-15daf849132a => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:12:49 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 67cf8e45-399b-4709-a994-15daf849132a] VM Stopped (Lifecycle Event)
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e0049ee1-f6ae-421f-ae1b-57c5b0bbc363 None None] [instance: 67cf8e45-399b-4709-a994-15daf849132a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:50 user nova-compute[82009]: INFO nova.compute.manager [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Detaching volume f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:50 user nova-compute[82009]: INFO nova.virt.block_device [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Attempting to driver detach volume f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 from mountpoint /dev/vdb
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Attempting to detach device vdb from instance c107e5ac-af58-4702-aa62-253f3424c585 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:12:50 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:50 user nova-compute[82009]:   <source dev="/dev/sdi"/>
Apr 11 18:12:50 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:50 user nova-compute[82009]:   <serial>f821ed7e-c1a1-4b28-a3da-7e2ce97b4139</serial>
Apr 11 18:12:50 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:12:50 user nova-compute[82009]: </disk>
Apr 11 18:12:50 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Successfully detached device vdb from instance c107e5ac-af58-4702-aa62-253f3424c585 from the persistent domain config.
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c107e5ac-af58-4702-aa62-253f3424c585 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:12:50 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:12:50 user nova-compute[82009]:   <source dev="/dev/sdi"/>
Apr 11 18:12:50 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:12:50 user nova-compute[82009]:   <serial>f821ed7e-c1a1-4b28-a3da-7e2ce97b4139</serial>
Apr 11 18:12:50 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:12:50 user nova-compute[82009]: </disk>
Apr 11 18:12:50 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-changed-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing instance network info cache due to event network-changed-ced10f2e-f2b3-49c0-9232-989b3cc110e0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Acquiring lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Acquired lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.network.neutron [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Refreshing network info cache for port ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:50 user nova-compute[82009]: INFO nova.compute.manager [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Terminating instance
Apr 11 18:12:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:51 user nova-compute[82009]: INFO nova.compute.manager [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Terminating instance
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236771.290822, c107e5ac-af58-4702-aa62-253f3424c585 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:12:51 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Successfully detached device vdb from instance c107e5ac-af58-4702-aa62-253f3424c585 from the live domain config.
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOvpAUnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'f821ed7e-c1a1-4b28-a3da-7e2ce97b4139': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:51 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c2b82-a3fd-47ae-85a5-1956195ee08b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:51 user nova-compute[82009]: No targets found.
Apr 11 18:12:51 user nova-compute[82009]: iSNS:
Apr 11 18:12:51 user nova-compute[82009]: No targets found.
Apr 11 18:12:51 user nova-compute[82009]: STATIC:
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:51 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:51 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:51 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:51 user nova-compute[82009]: No targets found.
Apr 11 18:12:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:51 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:51 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[547df598-4696-40ce-a866-b549ee89cf96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-4670f4fc-4560-4e6e-87b3-1d2fb72e3f11 req-d9f5b8ec-cb68-4ffd-9b76-3148fa40eb69 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9b5d4f-5a42-46d6-b647-6ba34e59ca35]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6bf0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139'): ({'sdi'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Removing single pathed devices sdi {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3ae9c-a0c9-441e-96a9-554e3a9c2dc1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5dd545-c332-4e11-b069-598eac5c34c0]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Flushing IO for device /dev/sdi {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6d1a9-b22e-4eb9-bd9b-4a91eec8d217]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d813dc5-37db-43d0-80aa-17b0aac80c9d]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] SCSI volumes sdi have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67867f-eae7-4319-8758-545713240a6e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.121s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4761a42-99f4-4e3d-849a-5dc1ee4a45ea]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260]
Apr 11 18:12:51 user nova-compute[82009]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f821ed7e-c1a1-4b28-a3da-7e2ce97b4139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c83082-1f87-4db3-8714-3f42a9eccb5d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] <== disconnect_volume: return (458ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:51 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-30daed2f-1a39-4506-9500-e41a2e54d746 req-37ed93ab-a5d1-4543-b3f0-ce3c5ffb92f8 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.network.neutron [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updated VIF entry in instance network info cache for port ced10f2e-f2b3-49c0-9232-989b3cc110e0. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.network.neutron [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-db8d6ef9-d983-4d1d-a33a-5000cf836429 req-18bf6b46-9dbd-41ee-8f86-e9d35c7c7338 service nova] Releasing lock "refresh_cache-cd86b2f4-002e-48ab-987c-b081681b5e07" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.objects.instance [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'flavor' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-71dd3f81-ace3-4d2f-a095-fe3b6579f309 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.174s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:52 user nova-compute[82009]: WARNING nova.compute.manager [req-eab40590-8586-4fde-bdad-9773a5ccd1e0 req-5680502e-6f32-43e5-9cbb-843340207e59 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa for instance with vm_state active and task_state deleting.
Apr 11 18:12:52 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Instance destroyed successfully.
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lazy-loading 'resources' on Instance uuid 3aedb5f4-32cf-497c-8035-0f694cbf78cf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "address": "fa:16:3e:1b:21:79", "network": {"id": "dd87d5bb-3e1f-4693-a28a-fee040d4ab81", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-650469206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9ebc37-36", "ovs_interfaceid": "8e9ebc37-3669-4688-97c5-f3ff04bc51e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e9ebc37-36, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Instance destroyed successfully.
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lazy-loading 'resources' on Instance uuid cd86b2f4-002e-48ab-987c-b081681b5e07 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced10f2e-f2, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:21:79,bridge_name='br-int',has_traffic_filtering=True,id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3,network=Network(dd87d5bb-3e1f-4693-a28a-fee040d4ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9ebc37-36')
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:53 user nova-compute[82009]: WARNING nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 for instance with vm_state active and task_state deleting.
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:53 user nova-compute[82009]: WARNING nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d for instance with vm_state active and task_state deleting.
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-11876d87-cfbc-4d1e-84aa-62d927337a20 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:53 user nova-compute[82009]: WARNING nova.compute.manager [req-40849252-ddc1-4e57-9544-5eb736afc229 req-ee66b00b-1d31-4ba0-b6c7-244274b7e00f service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-11876d87-cfbc-4d1e-84aa-62d927337a20 for instance with vm_state active and task_state deleting.
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903ba719-56, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:3a:66,bridge_name='br-int',has_traffic_filtering=True,id=ced10f2e-f2b3-49c0-9232-989b3cc110e0,network=Network(b27cadcc-09a1-423c-9133-cc109a427485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced10f2e-f2')
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap218012bb-cb, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:53 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=903ba719-5693-44ed-985d-74770767b6c5,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap903ba719-56')
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcec9b7a9-62, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:53 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:fa:83,bridge_name='br-int',has_traffic_filtering=True,id=218012bb-cbbd-412d-85af-8c76ac2c273d,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap218012bb-cb')
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b3c6247-4b, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=cec9b7a9-6277-4820-8c0b-0fb252127d98,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcec9b7a9-62')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7abbaabc-46, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:16:29,bridge_name='br-int',has_traffic_filtering=True,id=9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b3c6247-4b')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd517f24-d0, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:81,bridge_name='br-int',has_traffic_filtering=True,id=7abbaabc-4691-4bea-975e-632d04d0983d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7abbaabc-46')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a7ffc75-0c, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=cd517f24-d0a3-4a63-ad6d-9a2271f6d04e,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd517f24-d0')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "address": "fa:16:3e:13:63:9e", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb5ef9e9-ef", "ovs_interfaceid": "eb5ef9e9-efcf-479d-8113-f6c3d284bfaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-ced10f2e-f2b3-49c0-9232-989b3cc110e0 for instance with vm_state active and task_state deleting.
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-903ba719-5693-44ed-985d-74770767b6c5 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-903ba719-5693-44ed-985d-74770767b6c5 for instance with vm_state active and task_state deleting.
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-218012bb-cbbd-412d-85af-8c76ac2c273d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-218012bb-cbbd-412d-85af-8c76ac2c273d for instance with vm_state active and task_state deleting.
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING nova.compute.manager [req-8089bf0b-db5f-4bc3-9036-4fb31467047d req-ab586541-9298-4db0-80e4-d8a8d2f6eb66 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-cec9b7a9-6277-4820-8c0b-0fb252127d98 for instance with vm_state active and task_state deleting.
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb5ef9e9-ef, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:41,bridge_name='br-int',has_traffic_filtering=True,id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d,network=Network(3835c27b-305e-44a8-96aa-82303b37dd32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7ffc75-0c')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11876d87-cf, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa,network=Network(3be15b3c-4641-4591-9b74-24b58a38b9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb5ef9e9-ef')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a1999d0-5e, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:83:3b,bridge_name='br-int',has_traffic_filtering=True,id=11876d87-cfbc-4d1e-84aa-62d927337a20,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11876d87-cf')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-490010717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-490010717',id=11,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUxm6HkjNgutK3fF8yh9/6+7zFLYhmXYFzu0CoqC67WowTkU0uOEsk4IvXv0W5+Ullbd8KRF2JRSNKsUSvNx/7fxK9yGxnxPjOQBikbdvBBOLrLBKBMFV23lQky779Ng==',key_name='tempest-keypair-1551663442',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='661f042c46b14d2184cfaa77200899a8',ramdisk_id='',reservation_id='r-26d4maur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479213965',owner_user_name='tempest-TaggedBootDevicesTest-479213965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59738138e8c346a393ea13fe7fadbe88',uuid=3aedb5f4-32cf-497c-8035-0f694cbf78cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converting VIF {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1b4ee0-c7, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:57:73,bridge_name='br-int',has_traffic_filtering=True,id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a1999d0-5e')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-570145889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-570145889',id=10,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdihuFSB5URBxOp0QT0Ep88FE3HDkMYj66sfYj6nPAmHVcD0AA20tzZtMWy2TFMGcA0Su+HeGVHgM6WswZq7bEEtEiGplszyR7pDisWh/+W01I9//P7aORnPKQTIDDiNg==',key_name='tempest-keypair-2140518670',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e235e9f2e72e4fc28995bf9716d8e4ff',ramdisk_id='',reservation_id='r-xqcd8yg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1474407458',owner_user_name='tempest-TaggedBootDevicesTest_v242-1474407458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c63dc594a1a4977b67ccc1a63d09de4',uuid=cd86b2f4-002e-48ab-987c-b081681b5e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converting VIF {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccbdc6f5-62, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a,network=Network(9c992bb3-551b-4636-b2b8-4d2d82add7e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1b4ee0-c7')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuYLSHbz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:54 user nova-compute[82009]: INFO os_vif [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:15:b9,bridge_name='br-int',has_traffic_filtering=True,id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa,network=Network(eec313a6-f214-4b6e-bac2-d847c99dcedc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccbdc6f5-62')
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyDMlvqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[44181093-0dd3-4a92-a398-323c684ac9cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:54 user nova-compute[82009]: No targets found.
Apr 11 18:12:54 user nova-compute[82009]: iSNS:
Apr 11 18:12:54 user nova-compute[82009]: No targets found.
Apr 11 18:12:54 user nova-compute[82009]: STATIC:
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:54 user nova-compute[82009]: No targets found.
Apr 11 18:12:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:54 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:54 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ac674-c54d-4b87-9aa1-80cfe1bffc35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b58721-b1a1-4b70-afab-82f87ce7bf6a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e0416a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0800a7d0-7c16-4f1a-a70f-2d9713bb3f76]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e628cb-de67-4944-9cbd-329a9a0026c7]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade6c01-df15-48be-81ca-a23b6fb5f78d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[941fbb29-20e6-444f-8ab6-72221cb63826]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7467cc9e-c058-43f1-af88-2e3cd7f21ef6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b82e26-37a6-4d49-9948-781d7298d619]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260]
Apr 11 18:12:54 user nova-compute[82009]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4caf909-3c23-44c2-a1c4-72152f20bb4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1985e787-92a2-4b46-b5f4-284a02a22ce2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== disconnect_volume: return (428ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.423s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChxMzgmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e09694b-3d86-4912-9796-1598bb21919c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:54 user nova-compute[82009]: No targets found.
Apr 11 18:12:54 user nova-compute[82009]: iSNS:
Apr 11 18:12:54 user nova-compute[82009]: No targets found.
Apr 11 18:12:54 user nova-compute[82009]: STATIC:
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:54 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:54 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:54 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:54 user nova-compute[82009]: No targets found.
Apr 11 18:12:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:54 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:54 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76a37a-144b-4ce4-a26a-5f6b95f68b19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ad045c-d6a6-4499-816f-594b1888d526]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6b2d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728'): ({'sde'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Removing single pathed devices sde {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[65533195-7b08-4c25-b65f-4d4abccd513e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc400d1-5ce3-436b-8a3c-7eef6cd1ed65]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flushing IO for device /dev/sde {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b8dc7-b744-4044-a5a5-4b2c93f08732]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9215de-047c-48fc-b69d-6eca4cced20f]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8357d-7a72-4d94-a187-b51b91c654db]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a214cd6-7c11-4da5-b174-4cdf22c98c3a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260]
Apr 11 18:12:55 user nova-compute[82009]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7af65f-1aed-4e9e-b945-688f1ab39728 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa88d9-c9cd-424c-8ff3-ae29dd9c9682]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== disconnect_volume: return (820ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.394s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUzNFoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e92c5-009f-4b75-af68-d7552eef2fe6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:55 user nova-compute[82009]: No targets found.
Apr 11 18:12:55 user nova-compute[82009]: iSNS:
Apr 11 18:12:55 user nova-compute[82009]: No targets found.
Apr 11 18:12:55 user nova-compute[82009]: STATIC:
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:55 user nova-compute[82009]: No targets found.
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:55 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:55 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ae856-fff3-455e-abf0-d007ac65a30b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b984e703-1b58-4619-8b4f-af806588e87a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6bf3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970'): ({'sdf'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Removing single pathed devices sdf {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[62334763-135b-48b4-9d89-af72379fa600]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da77cda-923c-4667-8aaf-f1099b9c8219]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flushing IO for device /dev/sdf {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[75767017-f6cd-42b9-9b00-e91bd616413b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1433831-7ed1-42dc-a4b4-e515f0765207]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455d759-a1d8-4912-b0eb-069490117ec8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4420b190-cc96-43f9-a6ab-8c3cd7498330]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260]
Apr 11 18:12:55 user nova-compute[82009]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da10aa27-09c0-4428-b528-8c5555a12970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[24886e2f-d026-4537-a92d-f4a505c1b7e9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== disconnect_volume: return (845ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.448s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTOsHFro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae274dac-e715-4d7f-90bc-3dee8fd9fb21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:55 user nova-compute[82009]: No targets found.
Apr 11 18:12:55 user nova-compute[82009]: iSNS:
Apr 11 18:12:55 user nova-compute[82009]: No targets found.
Apr 11 18:12:55 user nova-compute[82009]: STATIC:
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:55 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:55 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:55 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:55 user nova-compute[82009]: No targets found.
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:55 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:55 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b8f1f-9c33-4349-bbcf-89b580c29c0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def619c-6539-4400-8e43-8a2b176aba07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:55 user nova-compute[82009]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 (non-flash)
Apr 11 18:12:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8289bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664'): ({'sdg'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Removing single pathed devices sdg {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15109300-65b9-4c33-80c7-e3f5891d8db8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=26.59009552001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42837c5-d76f-4bca-9b0d-fd9b6ca38a84]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flushing IO for device /dev/sdg {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d513c3bd-c37e-4b81-83ab-90ea041f83e2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c for instance with vm_state active and task_state deleting.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-7abbaabc-4691-4bea-975e-632d04d0983d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-7abbaabc-4691-4bea-975e-632d04d0983d for instance with vm_state active and task_state deleting.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e for instance with vm_state active and task_state deleting.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa for instance with vm_state active and task_state deleting.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-unplugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-unplugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] No waiting events found dispatching network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received unexpected event network-vif-plugged-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a for instance with vm_state active and task_state deleting.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-unplugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-854b55f9-c1f6-4522-80b6-870bde9c73df req-ff78ba1e-5fe4-4a9a-9023-5f426d792c99 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-unplugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[47581047-335f-4184-9bd2-928b1412aef2]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] SCSI volumes sdg have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148ace6-4144-4cf4-b489-7611175c72c9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c107e5ac-af58-4702-aa62-253f3424c585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance cd86b2f4-002e-48ab-987c-b081681b5e07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a815add-8280-40f4-b3b4-b17235ae903d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260]
Apr 11 18:12:56 user nova-compute[82009]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858c22bc-7928-4813-9303-f52929365664 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[725327b2-5a9c-4212-96c2-c935b8e817f6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.722s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== disconnect_volume: return (1171ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.714s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HoASLztv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:12:56 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb29f3-34b5-453f-8251-12e9b4972be2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:56 user nova-compute[82009]: No targets found.
Apr 11 18:12:56 user nova-compute[82009]: iSNS:
Apr 11 18:12:56 user nova-compute[82009]: No targets found.
Apr 11 18:12:56 user nova-compute[82009]: STATIC:
Apr 11 18:12:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02
Apr 11 18:12:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:56 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:56 user nova-compute[82009]: No targets found.
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:56 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:56 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d01e51-46e0-4ffd-9dde-77d7c4134c9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7048741-7823-40df-a549-becafde1ccd6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:56 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 (non-flash)
Apr 11 18:12:56 user nova-compute[82009]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6c23be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b6add8-1669-4cb4-8cbb-7c3589363080]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c08138-1a85-40fb-96b0-a32806b1a3dd]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69fc5c5-c31f-4d36-919a-a78f94678884]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad220d2-597e-438a-aa8d-1564b043c523]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33241c-97f6-4220-bcde-f207399678ff]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b768ace-1941-4386-be24-66089e8aa823]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260]
Apr 11 18:12:56 user nova-compute[82009]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f02bca93-4b17-45a3-bf13-273b5d34dc02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c334f9-a742-464b-af0a-b14ba73ffd66]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] <== disconnect_volume: return (1016ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:56 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Deleting instance files /opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf_del
Apr 11 18:12:56 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Deletion of /opt/stack/data/nova/instances/3aedb5f4-32cf-497c-8035-0f694cbf78cf_del complete
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.304s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad40308f-02a6-43b9-83e6-dead3547e425]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:12:56 user nova-compute[82009]: No targets found.
Apr 11 18:12:56 user nova-compute[82009]: iSNS:
Apr 11 18:12:56 user nova-compute[82009]: No targets found.
Apr 11 18:12:56 user nova-compute[82009]: STATIC:
Apr 11 18:12:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee
Apr 11 18:12:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:12:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:12:56 user nova-compute[82009]: FIRMWARE:
Apr 11 18:12:56 user nova-compute[82009]: No targets found.
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:12:56 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:12:56 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2312d259-2f7c-44c0-9860-b7a058d667ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: INFO nova.compute.manager [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Took 5.97 seconds to destroy the instance on the hypervisor.
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2205f-a4d7-4341-8ab0-b62836ac14c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee (non-flash)
Apr 11 18:12:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8289240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db59eee-9fed-453a-8839-1fe0bf26e6a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b792180-05b1-4a95-9144-0055717bc826]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b109466-88f7-4bda-ba7d-2c109c93712d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:12:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb43def-5409-449a-aa46-7fa3e509d056]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b5dc8-cda4-4fe5-aa16-2de76235d368]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eb613c-0399-406d-9c13-3c19b947f64e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260]
Apr 11 18:12:57 user nova-compute[82009]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee, portal: 172.16.0.220,3260] successful.
Apr 11 18:12:57 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe808d1-d7d3-4c81-b366-1b777fac9dee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3080d6f-0230-49cd-9e74-80a3291c2f32]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] <== disconnect_volume: return (624ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:12:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Deleting instance files /opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07_del
Apr 11 18:12:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Deletion of /opt/stack/data/nova/instances/cd86b2f4-002e-48ab-987c-b081681b5e07_del complete
Apr 11 18:12:57 user nova-compute[82009]: INFO nova.compute.manager [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Took 6.22 seconds to destroy the instance on the hypervisor.
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:12:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Acquiring lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:12:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:12:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:12:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] No waiting events found dispatching network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:12:58 user nova-compute[82009]: WARNING nova.compute.manager [req-f3dcaffb-2839-4e34-b566-eee1242c8c91 req-f69bd7a9-4628-44e7-a33f-34f99de98166 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received unexpected event network-vif-plugged-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 for instance with vm_state active and task_state deleting.
Apr 11 18:12:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-deleted-eb5ef9e9-efcf-479d-8113-f6c3d284bfaa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:12:58 user nova-compute[82009]: INFO nova.compute.manager [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Neutron deleted interface eb5ef9e9-efcf-479d-8113-f6c3d284bfaa; detaching it from the instance and deleting it from the info cache
Apr 11 18:12:58 user nova-compute[82009]: DEBUG nova.network.neutron [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "address": "fa:16:3e:80:57:73", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a1999d0-5e", "ovs_interfaceid": "5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:12:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-e3d92af6-6520-4eee-abb1-8c3639d0d06a req-27a7c852-9d1d-4626-9895-3faa82381de9 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Detach interface failed, port_id=eb5ef9e9-efcf-479d-8113-f6c3d284bfaa, reason: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:12:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-deleted-8e9ebc37-3669-4688-97c5-f3ff04bc51e3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:00 user nova-compute[82009]: INFO nova.compute.manager [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Neutron deleted interface 8e9ebc37-3669-4688-97c5-f3ff04bc51e3; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:00 user nova-compute[82009]: DEBUG nova.network.neutron [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "address": "fa:16:3e:b4:80:41", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7ffc75-0c", "ovs_interfaceid": "9a7ffc75-0c3a-4516-a414-bb6e41a59c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Detach interface failed, port_id=8e9ebc37-3669-4688-97c5-f3ff04bc51e3, reason: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-deleted-9a7ffc75-0c3a-4516-a414-bb6e41a59c1d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:00 user nova-compute[82009]: INFO nova.compute.manager [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Neutron deleted interface 9a7ffc75-0c3a-4516-a414-bb6e41a59c1d; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:00 user nova-compute[82009]: DEBUG nova.network.neutron [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "address": "fa:16:3e:93:63:a9", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1b4ee0-c7", "ovs_interfaceid": "9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-9339f699-3744-4e91-87e9-3a60a51bef64 req-926c61e6-666d-4fe3-a8d2-12976330efc5 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Detach interface failed, port_id=9a7ffc75-0c3a-4516-a414-bb6e41a59c1d, reason: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-deleted-5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:01 user nova-compute[82009]: INFO nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Neutron deleted interface 5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "address": "fa:16:3e:e7:15:b9", "network": {"id": "eec313a6-f214-4b6e-bac2-d847c99dcedc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1890769176", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccbdc6f5-62", "ovs_interfaceid": "ccbdc6f5-6226-4b61-8ec9-45e77798e8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Detach interface failed, port_id=5a1999d0-5e83-4f1b-bba1-1ebc2a31cca1, reason: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-deleted-ccbdc6f5-6226-4b61-8ec9-45e77798e8aa {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:01 user nova-compute[82009]: INFO nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Neutron deleted interface ccbdc6f5-6226-4b61-8ec9-45e77798e8aa; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "address": "fa:16:3e:a9:3a:66", "network": {"id": "b27cadcc-09a1-423c-9133-cc109a427485", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-776486108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced10f2e-f2", "ovs_interfaceid": "ced10f2e-f2b3-49c0-9232-989b3cc110e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Detach interface failed, port_id=ccbdc6f5-6226-4b61-8ec9-45e77798e8aa, reason: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-deleted-ced10f2e-f2b3-49c0-9232-989b3cc110e0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:01 user nova-compute[82009]: INFO nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Neutron deleted interface ced10f2e-f2b3-49c0-9232-989b3cc110e0; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [{"id": "218012bb-cbbd-412d-85af-8c76ac2c273d", "address": "fa:16:3e:27:fa:83", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218012bb-cb", "ovs_interfaceid": "218012bb-cbbd-412d-85af-8c76ac2c273d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "address": "fa:16:3e:c4:16:29", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3c6247-4b", "ovs_interfaceid": "9b3c6247-4ba6-4eb1-b272-1f1bc54fb77c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "address": "fa:16:3e:26:7c:7c", "network": {"id": "3be15b3c-4641-4591-9b74-24b58a38b9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-194584691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e235e9f2e72e4fc28995bf9716d8e4ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd517f24-d0", "ovs_interfaceid": "cd517f24-d0a3-4a63-ad6d-9a2271f6d04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-4c0cbaa0-d718-4eb3-a26b-662e572ef370 req-a47c2c34-24d2-4268-aa08-f2ec4fa0d6ba service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Detach interface failed, port_id=ced10f2e-f2b3-49c0-9232-989b3cc110e0, reason: Instance cd86b2f4-002e-48ab-987c-b081681b5e07 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:01 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:01 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Took 4.05 seconds to deallocate network for instance.
Apr 11 18:13:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-deleted-9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:02 user nova-compute[82009]: INFO nova.compute.manager [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Neutron deleted interface 9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:02 user nova-compute[82009]: DEBUG nova.network.neutron [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7abbaabc-4691-4bea-975e-632d04d0983d", "address": "fa:16:3e:46:62:81", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7abbaabc-46", "ovs_interfaceid": "7abbaabc-4691-4bea-975e-632d04d0983d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Detach interface failed, port_id=9c1b4ee0-c7c6-448b-bea7-ad10c56f9a5a, reason: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-deleted-7abbaabc-4691-4bea-975e-632d04d0983d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:03 user nova-compute[82009]: INFO nova.compute.manager [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Neutron deleted interface 7abbaabc-4691-4bea-975e-632d04d0983d; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [{"id": "903ba719-5693-44ed-985d-74770767b6c5", "address": "fa:16:3e:02:c6:90", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903ba719-56", "ovs_interfaceid": "903ba719-5693-44ed-985d-74770767b6c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "address": "fa:16:3e:17:60:f8", "network": {"id": "3835c27b-305e-44a8-96aa-82303b37dd32", "bridge": "br-int", "label": "tempest-device-tagging-net1-124370275", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec9b7a9-62", "ovs_interfaceid": "cec9b7a9-6277-4820-8c0b-0fb252127d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "11876d87-cfbc-4d1e-84aa-62d927337a20", "address": "fa:16:3e:93:83:3b", "network": {"id": "9c992bb3-551b-4636-b2b8-4d2d82add7e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-917337233", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "661f042c46b14d2184cfaa77200899a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11876d87-cf", "ovs_interfaceid": "11876d87-cfbc-4d1e-84aa-62d927337a20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-88a4a395-5849-4a27-bf6f-951a0834205d req-2d3fc153-5319-4be7-b90a-6a6f3d62a7c2 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Detach interface failed, port_id=7abbaabc-4691-4bea-975e-632d04d0983d, reason: Instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-1deca141-4db6-4569-b90b-91c4608cd521 req-664150eb-facc-44a5-bcd9-5b0d6a86c804 service nova] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Received event network-vif-deleted-cd517f24-d0a3-4a63-ad6d-9a2271f6d04e {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:03 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:03 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Took 6.69 seconds to deallocate network for instance.
Apr 11 18:13:03 user nova-compute[82009]: INFO nova.compute.manager [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Took 2.52 seconds to detach 3 volumes for instance.
Apr 11 18:13:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:04 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:13:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:13:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:04 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Deleted allocations for instance cd86b2f4-002e-48ab-987c-b081681b5e07
Apr 11 18:13:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cf8d4bd-298e-4cc0-aaff-324e869c07bb tempest-TaggedBootDevicesTest_v242-1474407458 tempest-TaggedBootDevicesTest_v242-1474407458-project-member] Lock "cd86b2f4-002e-48ab-987c-b081681b5e07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.332s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-5bc45ea8-cd85-4abd-8e5b-0b36295ca7bf req-20bbf636-49e1-47ef-8ca4-fbb7bdee1d32 service nova] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Received event network-vif-deleted-11876d87-cfbc-4d1e-84aa-62d927337a20 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:06 user nova-compute[82009]: INFO nova.compute.manager [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Took 2.47 seconds to detach 3 volumes for instance.
Apr 11 18:13:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:06 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:13:06 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:13:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:06 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Deleted allocations for instance 3aedb5f4-32cf-497c-8035-0f694cbf78cf
Apr 11 18:13:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f764b83c-0d4b-45e5-a78d-af466c0cf1cd tempest-TaggedBootDevicesTest-479213965 tempest-TaggedBootDevicesTest-479213965-project-member] Lock "3aedb5f4-32cf-497c-8035-0f694cbf78cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.570s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:07 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236772.9217372, 3aedb5f4-32cf-497c-8035-0f694cbf78cf => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:07 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] VM Stopped (Lifecycle Event)
Apr 11 18:13:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-6c25e2e6-487e-4c9e-9d6e-ea0ed6d16ee7 None None] [instance: 3aedb5f4-32cf-497c-8035-0f694cbf78cf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:08 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236773.1510758, cd86b2f4-002e-48ab-987c-b081681b5e07 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:08 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] VM Stopped (Lifecycle Event)
Apr 11 18:13:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-5dd346c5-7e9a-43f4-b047-89993eb8a2d3 None None] [instance: cd86b2f4-002e-48ab-987c-b081681b5e07] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:13 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'flavor' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:14 user nova-compute[82009]: INFO nova.compute.manager [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Attaching volume 66e98e6d-f7ea-48df-a28b-c9148c90317e to /dev/vdb
Apr 11 18:13:14 user nova-compute[82009]: DEBUG os_brick.utils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[06052a1a-b202-422a-97cb-34f1dfc2f53c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e384c5d0-fb39-48bc-9d08-2b66a7f8a1fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b843938-883b-488a-9d8f-29a371bbe59e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[103f7dfe-7c48-43e5-9b0c-08c5cf32cbe0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:13:14 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:13:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cfd7ee-1198-43a6-83ec-6ad45ec735c8]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG os_brick.utils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating existing volume attachment record: 031b8762-302d-4d6b-9230-69567af5932e {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:13:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:18 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:18 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:18 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216d816-2fef-494f-8880-ed7bf6005af0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:13:18 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1491c5-2806-41aa-a612-59053fba3f02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e] added
Apr 11 18:13:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49e939-85a7-4736-94a8-d3d51a013178]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9683f-ca24-47cd-803e-2e35acdd0607]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWVryuZn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWVryuZn" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95b205d-dcfc-4282-b44a-58139e572f3e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWVryuZn'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2aa31-3499-48bf-9487-979664770c97]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d07bff5-44c9-4f9d-a5d0-a119ed5cf903]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:13:18 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:13:18 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:18 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:13:18 user nova-compute[82009]: 
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[48279310-8847-489b-b513-bdc1def0eb4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]
Apr 11 18:13:18 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.
Apr 11 18:13:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29fb036-1786-4451-8910-ceb06d011cba]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd063567-21d1-46f7-bace-c4a3aa06120d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af5a143-9bdf-4c80-a107-51e5b12f792d]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:13:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26234653839633735', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:13:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234653839633735', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:13:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'flavor' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:13:19 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:13:19 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:13:19 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:13:19 user nova-compute[82009]:   <serial>66e98e6d-f7ea-48df-a28b-c9148c90317e</serial>
Apr 11 18:13:19 user nova-compute[82009]: </disk>
Apr 11 18:13:19 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:13:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:13:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:13:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No VIF found with MAC fa:16:3e:43:43:b7, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:13:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bd38c82c-8ca7-47aa-85de-d31b9e892798 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.389s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:13:24 user nova-compute[82009]: INFO nova.compute.claims [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Claim successful on node user
Apr 11 18:13:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-changed-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing instance network info cache due to event network-changed-9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.network.neutron [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing network info cache for port 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:13:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:13:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:13:24 user nova-compute[82009]: INFO nova.virt.block_device [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Booting with volume c2cc9035-772b-48ee-8fd4-b89cd9319142 at /dev/vda
Apr 11 18:13:24 user nova-compute[82009]: DEBUG os_brick.utils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c5165c-1f2f-47e4-be09-305a6f14afdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2936d2-693d-4ee7-aa5f-745d77876510]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d7d556-a6f9-4311-b6a8-58f4171ecccf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[80613a03-b5bc-4548-ada0-1aceb71b3443]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:13:25 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:13:25 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa6b73-5064-4954-8a8e-fea81316c7cc]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG os_brick.utils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating existing volume attachment record: 85e85fcd-6bd5-4dc5-a041-b2cf6a579d99 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updated VIF entry in instance network info cache for port 9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d8c1ac81-c794-4b87-809c-516bb49c36de req-14301a06-ffc6-4672-9580-1519d29e64b3 service nova] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:25 user nova-compute[82009]: DEBUG nova.policy [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43dc7c5c888247029ff6adedbdb2e938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090bfb65d0c4afeb5ac38c45083799d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:13:26 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Successfully created port: d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:13:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Successfully updated port: d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-changed-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing instance network info cache due to event network-changed-9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG nova.network.neutron [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing network info cache for port 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:13:27 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:13:28 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:28 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance network_info: |[{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:13:28 user nova-compute[82009]: DEBUG nova.network.neutron [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updated VIF entry in instance network info cache for port 9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:13:28 user nova-compute[82009]: DEBUG nova.network.neutron [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6e4eefb7-e9e8-4922-99fb-cb7fba529a55 req-4fe5fc56-426e-45cf-8113-54b67b5b5caf service nova] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:29 user nova-compute[82009]: INFO nova.compute.manager [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Rebooting instance
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.network.neutron [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:13:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Creating image(s)
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Ensure instance console log exists: /opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Start _get_guest_xml network_info=[{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '85e85fcd-6bd5-4dc5-a041-b2cf6a579d99', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2fef8f1e-9300-4bd6-8958-4386541a9c0c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2cc9035-772b-48ee-8fd4-b89cd9319142', 'serial': 'c2cc9035-772b-48ee-8fd4-b89cd9319142'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:13:29 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:29 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:29 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:29 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:29 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-changed-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing instance network info cache due to event network-changed-d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG nova.network.neutron [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing network info cache for port d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f3bc6-64ed-4021-8893-885cce6cad8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:13:29 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eeab64-b6b0-4fef-afc7-0cb0b8922154]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142] added
Apr 11 18:13:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[856991d4-28b6-4379-9bd4-c07109f89c9f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be470e8-37bf-4a9d-b56a-1af72b7e18b3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kESRZuIo {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kESRZuIo" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141dd42-f49c-4e86-85bf-f80892767398]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kESRZuIo'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b5311-5f27-4997-ba8f-7dfa585fb64e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.065s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2391258a-49e9-4231-a356-ea839c06267e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2169f680-a2b2-42eb-a153-c1e9c5d001a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]
Apr 11 18:13:30 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.
Apr 11 18:13:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG nova.network.neutron [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74779677-3ac2-4b03-9ccf-66af731f48a4]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d563c0b9-9092-435d-b6f8-0a015f69d457]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:30 user nova-compute[82009]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:30 user nova-compute[82009]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55eeb6d-841e-402c-8304-b3f1c2d29104]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updated VIF entry in instance network info cache for port d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4499b3b5-918d-430a-ac5b-4261a43babe6 req-8996ecaa-0649-4057-b86c-738d81499d24 service nova] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-unplugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-unplugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:30 user nova-compute[82009]: WARNING nova.compute.manager [req-ecfb4078-b237-4495-8f3a-9370709906f6 req-653af819-3cc3-492a-85f2-e7e48c215015 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-unplugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 18:13:31 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance destroyed successfully.
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.objects.instance [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'resources' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-621502840',display_name='tempest-TestMinimumBasicScenario-server-621502840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-621502840',id=12,image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw==',key_name='tempest-TestMinimumBasicScenario-1430519022',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-tfsvslnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:13:30Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=2e78a3ea-f132-4da0-81f1-d6745390b0d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f1432e1-14, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: INFO os_vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14')
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:31 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26133613830333863', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133613830333863', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.084s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[52736be0-d9e4-4c1f-bcb7-4b4f3f124e40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:13:31 user nova-compute[82009]: No targets found.
Apr 11 18:13:31 user nova-compute[82009]: iSNS:
Apr 11 18:13:31 user nova-compute[82009]: No targets found.
Apr 11 18:13:31 user nova-compute[82009]: STATIC:
Apr 11 18:13:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:13:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:13:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:13:31 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e
Apr 11 18:13:31 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:13:31 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:13:31 user nova-compute[82009]: FIRMWARE:
Apr 11 18:13:31 user nova-compute[82009]: No targets found.
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:13:31 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:13:31 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1554900069',display_name='tempest-TestShelveInstance-server-1554900069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1554900069',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJoEwkISzTf/Xl7bcqN5WFtK8IzBxrVabbCuw9Mu4MRtB0G1QNlNr8PwZepxAvxrQAcbqFk6TTH2cZjSmdlEbyBSzPwALnwMfNcWaTDuhhOtxF38FYCkmUerlI+JQ1TEg==',key_name='tempest-TestShelveInstance-1371472427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6090bfb65d0c4afeb5ac38c45083799d',ramdisk_id='',reservation_id='r-trhuh3i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-839951281',owner_user_name='tempest-TestShelveInstance-839951281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:13:25Z,user_data=None,user_id='43dc7c5c888247029ff6adedbdb2e938',uuid=2fef8f1e-9300-4bd6-8958-4386541a9c0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converting VIF {"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.objects.instance [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:13:31 user nova-compute[82009]:   <uuid>2fef8f1e-9300-4bd6-8958-4386541a9c0c</uuid>
Apr 11 18:13:31 user nova-compute[82009]:   <name>instance-0000000d</name>
Apr 11 18:13:31 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:13:31 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:13:31 user nova-compute[82009]:   <metadata>
Apr 11 18:13:31 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:13:31 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:13:31 user nova-compute[82009]:       <nova:name>tempest-TestShelveInstance-server-1554900069</nova:name>
Apr 11 18:13:31 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:13:29</nova:creationTime>
Apr 11 18:13:31 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:13:31 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:13:31 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:13:31 user nova-compute[82009]:       <nova:owner>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:user uuid="43dc7c5c888247029ff6adedbdb2e938">tempest-TestShelveInstance-839951281-project-member</nova:user>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:project uuid="6090bfb65d0c4afeb5ac38c45083799d">tempest-TestShelveInstance-839951281</nova:project>
Apr 11 18:13:31 user nova-compute[82009]:       </nova:owner>
Apr 11 18:13:31 user nova-compute[82009]:       <nova:ports>
Apr 11 18:13:31 user nova-compute[82009]:         <nova:port uuid="d870c097-5a51-464e-94e5-d29336bee09d">
Apr 11 18:13:31 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:13:31 user nova-compute[82009]:         </nova:port>
Apr 11 18:13:31 user nova-compute[82009]:       </nova:ports>
Apr 11 18:13:31 user nova-compute[82009]:     </nova:instance>
Apr 11 18:13:31 user nova-compute[82009]:   </metadata>
Apr 11 18:13:31 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:13:31 user nova-compute[82009]:     <system>
Apr 11 18:13:31 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:13:31 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:13:31 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:13:31 user nova-compute[82009]:       <entry name="serial">2fef8f1e-9300-4bd6-8958-4386541a9c0c</entry>
Apr 11 18:13:31 user nova-compute[82009]:       <entry name="uuid">2fef8f1e-9300-4bd6-8958-4386541a9c0c</entry>
Apr 11 18:13:31 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:13:31 user nova-compute[82009]:     </system>
Apr 11 18:13:31 user nova-compute[82009]:   </sysinfo>
Apr 11 18:13:31 user nova-compute[82009]:   <os>
Apr 11 18:13:31 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:13:31 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:13:31 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:13:31 user nova-compute[82009]:   </os>
Apr 11 18:13:31 user nova-compute[82009]:   <features>
Apr 11 18:13:31 user nova-compute[82009]:     <acpi/>
Apr 11 18:13:31 user nova-compute[82009]:     <apic/>
Apr 11 18:13:31 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:13:31 user nova-compute[82009]:   </features>
Apr 11 18:13:31 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:13:31 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:13:31 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:13:31 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:13:31 user nova-compute[82009]:   </clock>
Apr 11 18:13:31 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:13:31 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:13:31 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:13:31 user nova-compute[82009]:   </cpu>
Apr 11 18:13:31 user nova-compute[82009]:   <devices>
Apr 11 18:13:31 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:13:31 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:13:31 user nova-compute[82009]:       <source dev="/dev/sdc"/>
Apr 11 18:13:31 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:13:31 user nova-compute[82009]:       <serial>c2cc9035-772b-48ee-8fd4-b89cd9319142</serial>
Apr 11 18:13:31 user nova-compute[82009]:     </disk>
Apr 11 18:13:31 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:13:31 user nova-compute[82009]:       <mac address="fa:16:3e:7d:03:34"/>
Apr 11 18:13:31 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:13:31 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:13:31 user nova-compute[82009]:       <target dev="tapd870c097-5a"/>
Apr 11 18:13:31 user nova-compute[82009]:     </interface>
Apr 11 18:13:31 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:13:31 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c/console.log" append="off"/>
Apr 11 18:13:31 user nova-compute[82009]:     </serial>
Apr 11 18:13:31 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:13:31 user nova-compute[82009]:     <video>
Apr 11 18:13:31 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:13:31 user nova-compute[82009]:     </video>
Apr 11 18:13:31 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:13:31 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:13:31 user nova-compute[82009]:     </rng>
Apr 11 18:13:31 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:13:31 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:13:31 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:13:31 user nova-compute[82009]:     </memballoon>
Apr 11 18:13:31 user nova-compute[82009]:   </devices>
Apr 11 18:13:31 user nova-compute[82009]: </domain>
Apr 11 18:13:31 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1554900069',display_name='tempest-TestShelveInstance-server-1554900069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1554900069',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJoEwkISzTf/Xl7bcqN5WFtK8IzBxrVabbCuw9Mu4MRtB0G1QNlNr8PwZepxAvxrQAcbqFk6TTH2cZjSmdlEbyBSzPwALnwMfNcWaTDuhhOtxF38FYCkmUerlI+JQ1TEg==',key_name='tempest-TestShelveInstance-1371472427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6090bfb65d0c4afeb5ac38c45083799d',ramdisk_id='',reservation_id='r-trhuh3i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-839951281',owner_user_name='tempest-TestShelveInstance-839951281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:13:25Z,user_data=None,user_id='43dc7c5c888247029ff6adedbdb2e938',uuid=2fef8f1e-9300-4bd6-8958-4386541a9c0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converting VIF {"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_vif [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f9300-0189-4ee5-99ba-d9521168b29d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd870c097-5a, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd870c097-5a, col_values=(('external_ids', {'iface-id': 'd870c097-5a51-464e-94e5-d29336bee09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:03:34', 'vm-uuid': '2fef8f1e-9300-4bd6-8958-4386541a9c0c'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:31 user nova-compute[82009]: INFO os_vif [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a')
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22fbc9c-cd82-45f5-8b70-485085e8a6e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:31 user nova-compute[82009]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:31 user nova-compute[82009]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8289360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03d5fb-1ef2-4c13-ab30-58c5ba5e26ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] No VIF found with MAC fa:16:3e:7d:03:34, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f00878-cf56-4a49-adf1-956217bdb896]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bbc6cd-294e-42cc-8fa5-3417c6b86acd]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249b440-cc1c-48c3-9250-a4d47e016600]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915545d-eade-49bc-b9e0-9ba9b00d2158]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3126d6-970a-41ac-840d-e96f80de1c3a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]
Apr 11 18:13:31 user nova-compute[82009]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7815fc99-5b1a-4dca-a840-113018098583]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== disconnect_volume: return (407ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Start _get_guest_xml network_info=[{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '031b8762-302d-4d6b-9230-69567af5932e', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2e78a3ea-f132-4da0-81f1-d6745390b0d6', 'attached_at': '', 'detached_at': '', 'volume_id': '66e98e6d-f7ea-48df-a28b-c9148c90317e', 'serial': '66e98e6d-f7ea-48df-a28b-c9148c90317e'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:13:31 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:31 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.objects.instance [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:31 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:31 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:13:31 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8926fecc-31cf-4a19-977c-c5f7f1d73dba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:13:31 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119e60a-32e5-4a6c-8d9c-04df566ad8fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e] added
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc4de54-caa8-4ade-958c-3fd2012b1c18]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[524ac05b-9983-46d8-a283-3852ce268056]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWVryuZn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWVryuZn" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b094ff-0917-4b2b-9eb4-1faadb49d634]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWVryuZn'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e4a53-3c3f-470d-a308-9e1312c5e7e6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e4cc9c-33a6-431e-bc47-50b6ad66071c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c76b91-2209-46f9-8150-129a3033a7bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]
Apr 11 18:13:31 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1778e9af-bc9b-466a-9456-b03acd7fe428]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[32141200-a141-422c-be0a-e9d6aa6c1e27]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:31 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:13:31 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:13:31 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2375089c-0849-4092-96f7-126183d9642e]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:13:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26234653839633735', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234653839633735', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:32 user nova-compute[82009]: WARNING nova.compute.manager [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:32 user nova-compute[82009]: WARNING nova.compute.manager [req-fbc15ed3-574e-4217-8361-1e1db46b824c req-ce1bcf80-307a-4a49-b200-765be62dcd89 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state building and task_state spawning.
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-621502840',display_name='tempest-TestMinimumBasicScenario-server-621502840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-621502840',id=12,image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw==',key_name='tempest-TestMinimumBasicScenario-1430519022',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-tfsvslnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:13:30Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=2e78a3ea-f132-4da0-81f1-d6745390b0d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:13:32 user nova-compute[82009]:   <uuid>2e78a3ea-f132-4da0-81f1-d6745390b0d6</uuid>
Apr 11 18:13:32 user nova-compute[82009]:   <name>instance-0000000c</name>
Apr 11 18:13:32 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:13:32 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:13:32 user nova-compute[82009]:   <metadata>
Apr 11 18:13:32 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:13:32 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:13:32 user nova-compute[82009]:       <nova:name>tempest-TestMinimumBasicScenario-server-621502840</nova:name>
Apr 11 18:13:32 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:13:31</nova:creationTime>
Apr 11 18:13:32 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:13:32 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:13:32 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:13:32 user nova-compute[82009]:       <nova:owner>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:user uuid="dd1c4ded6c544d6eb16e9086c6259750">tempest-TestMinimumBasicScenario-492134328-project-member</nova:user>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:project uuid="a70e133c013140e1a17804737f4e3ef7">tempest-TestMinimumBasicScenario-492134328</nova:project>
Apr 11 18:13:32 user nova-compute[82009]:       </nova:owner>
Apr 11 18:13:32 user nova-compute[82009]:       <nova:root type="image" uuid="88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de"/>
Apr 11 18:13:32 user nova-compute[82009]:       <nova:ports>
Apr 11 18:13:32 user nova-compute[82009]:         <nova:port uuid="9f1432e1-1448-4815-a940-c004344002a0">
Apr 11 18:13:32 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:13:32 user nova-compute[82009]:         </nova:port>
Apr 11 18:13:32 user nova-compute[82009]:       </nova:ports>
Apr 11 18:13:32 user nova-compute[82009]:     </nova:instance>
Apr 11 18:13:32 user nova-compute[82009]:   </metadata>
Apr 11 18:13:32 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:13:32 user nova-compute[82009]:     <system>
Apr 11 18:13:32 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:13:32 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:13:32 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:13:32 user nova-compute[82009]:       <entry name="serial">2e78a3ea-f132-4da0-81f1-d6745390b0d6</entry>
Apr 11 18:13:32 user nova-compute[82009]:       <entry name="uuid">2e78a3ea-f132-4da0-81f1-d6745390b0d6</entry>
Apr 11 18:13:32 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:13:32 user nova-compute[82009]:     </system>
Apr 11 18:13:32 user nova-compute[82009]:   </sysinfo>
Apr 11 18:13:32 user nova-compute[82009]:   <os>
Apr 11 18:13:32 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:13:32 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:13:32 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:13:32 user nova-compute[82009]:   </os>
Apr 11 18:13:32 user nova-compute[82009]:   <features>
Apr 11 18:13:32 user nova-compute[82009]:     <acpi/>
Apr 11 18:13:32 user nova-compute[82009]:     <apic/>
Apr 11 18:13:32 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:13:32 user nova-compute[82009]:   </features>
Apr 11 18:13:32 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:13:32 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:13:32 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:13:32 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:13:32 user nova-compute[82009]:   </clock>
Apr 11 18:13:32 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:13:32 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:13:32 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:13:32 user nova-compute[82009]:   </cpu>
Apr 11 18:13:32 user nova-compute[82009]:   <devices>
Apr 11 18:13:32 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:13:32 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:13:32 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk"/>
Apr 11 18:13:32 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:13:32 user nova-compute[82009]:     </disk>
Apr 11 18:13:32 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:13:32 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:13:32 user nova-compute[82009]:       <source dev="/dev/sdb"/>
Apr 11 18:13:32 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:13:32 user nova-compute[82009]:       <serial>66e98e6d-f7ea-48df-a28b-c9148c90317e</serial>
Apr 11 18:13:32 user nova-compute[82009]:     </disk>
Apr 11 18:13:32 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:13:32 user nova-compute[82009]:       <mac address="fa:16:3e:43:43:b7"/>
Apr 11 18:13:32 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:13:32 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:13:32 user nova-compute[82009]:       <target dev="tap9f1432e1-14"/>
Apr 11 18:13:32 user nova-compute[82009]:     </interface>
Apr 11 18:13:32 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:13:32 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/console.log" append="off"/>
Apr 11 18:13:32 user nova-compute[82009]:     </serial>
Apr 11 18:13:32 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:13:32 user nova-compute[82009]:     <video>
Apr 11 18:13:32 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:13:32 user nova-compute[82009]:     </video>
Apr 11 18:13:32 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:13:32 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:13:32 user nova-compute[82009]:     </rng>
Apr 11 18:13:32 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:13:32 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:13:32 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:13:32 user nova-compute[82009]:     </memballoon>
Apr 11 18:13:32 user nova-compute[82009]:   </devices>
Apr 11 18:13:32 user nova-compute[82009]: </domain>
Apr 11 18:13:32 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:13:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Cannot resize image /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'migration_context' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-621502840',display_name='tempest-TestMinimumBasicScenario-server-621502840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-621502840',id=12,image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw==',key_name='tempest-TestMinimumBasicScenario-1430519022',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-tfsvslnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:13:30Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=2e78a3ea-f132-4da0-81f1-d6745390b0d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG os_vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f1432e1-14, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f1432e1-14, col_values=(('external_ids', {'iface-id': '9f1432e1-1448-4815-a940-c004344002a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:43:b7', 'vm-uuid': '2e78a3ea-f132-4da0-81f1-d6745390b0d6'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:33 user nova-compute[82009]: INFO os_vif [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14')
Apr 11 18:13:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236814.7973902, 2fef8f1e-9300-4bd6-8958-4386541a9c0c => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] VM Resumed (Lifecycle Event)
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:13:34 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance spawned successfully.
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236814.7985902, 2fef8f1e-9300-4bd6-8958-4386541a9c0c => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] VM Started (Lifecycle Event)
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:13:34 user nova-compute[82009]: INFO nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Took 5.21 seconds to spawn the instance on the hypervisor.
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:34 user nova-compute[82009]: WARNING nova.compute.manager [req-f3331006-5894-4369-a3c8-3f135210c81d req-2cac66f7-f4bd-4da8-a444-4ca2d2f4e05f service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state building and task_state spawning.
Apr 11 18:13:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:35 user nova-compute[82009]: INFO nova.compute.manager [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Took 10.76 seconds to build instance.
Apr 11 18:13:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cb480b18-b6e0-4d02-b806-415f2b872624 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.886s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:37 user nova-compute[82009]: WARNING nova.compute.manager [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:37 user nova-compute[82009]: WARNING nova.compute.manager [req-c9699cd8-d667-4967-80f4-77ff418f4a22 req-1a7a1cd1-3fa9-428b-92f9-5945012f48b5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 2e78a3ea-f132-4da0-81f1-d6745390b0d6 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236817.4265265, 2e78a3ea-f132-4da0-81f1-d6745390b0d6 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:37 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] VM Resumed (Lifecycle Event)
Apr 11 18:13:37 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance rebooted successfully.
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:13:37 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236817.426809, 2e78a3ea-f132-4da0-81f1-d6745390b0d6 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:37 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] VM Started (Lifecycle Event)
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-989e0b11-1463-4201-9ca0-f8f0685cff3c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.100s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:37 user nova-compute[82009]: INFO nova.compute.manager [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Terminating instance
Apr 11 18:13:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Instance destroyed successfully.
Apr 11 18:13:38 user nova-compute[82009]: DEBUG nova.objects.instance [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lazy-loading 'resources' on Instance uuid 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1489917956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1489917956',id=9,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkhdG0aqnnrwgW5YCJLPiQDhGmp49fwTJwGMPmD6bmOEwryqAAjPm2Hm0ynW0hDMApZRX9ozuSY9h7lfg6u/hfkoiuj2uZczEbMpxs+BNUcImHbeHzxHGX9iczWfaHthg==',key_name='tempest-keypair-120431301',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9376efafce66467aa4efde41acbce713',ramdisk_id='',reservation_id='r-0vs0nait',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-915024626',owner_user_name='tempest-TaggedAttachmentsTest-915024626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d70760a1251b4629afcc8c80ae00c659',uuid=9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converting VIF {"id": "8967a8d4-b607-4572-bfc2-50c7663563cb", "address": "fa:16:3e:b3:20:c6", "network": {"id": "3821437a-f673-4707-9824-285d5363f1c3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2061406529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9376efafce66467aa4efde41acbce713", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8967a8d4-b6", "ovs_interfaceid": "8967a8d4-b607-4572-bfc2-50c7663563cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG os_vif [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8967a8d4-b6, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:13:38 user nova-compute[82009]: INFO os_vif [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:20:c6,bridge_name='br-int',has_traffic_filtering=True,id=8967a8d4-b607-4572-bfc2-50c7663563cb,network=Network(3821437a-f673-4707-9824-285d5363f1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8967a8d4-b6')
Apr 11 18:13:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Deleting instance files /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b_del
Apr 11 18:13:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Deletion of /opt/stack/data/nova/instances/9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b_del complete
Apr 11 18:13:38 user nova-compute[82009]: INFO nova.compute.manager [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 11 18:13:38 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:13:38 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-unplugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-unplugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-unplugged-8967a8d4-b607-4572-bfc2-50c7663563cb for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Acquiring lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] No waiting events found dispatching network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:39 user nova-compute[82009]: WARNING nova.compute.manager [req-c06eb2c1-f205-4349-8d59-7cd1d4edfb4d req-1ef9b20c-404b-4d79-8fb0-1edb74156b05 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received unexpected event network-vif-plugged-8967a8d4-b607-4572-bfc2-50c7663563cb for instance with vm_state active and task_state deleting.
Apr 11 18:13:40 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Received event network-vif-deleted-8967a8d4-b607-4572-bfc2-50c7663563cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:40 user nova-compute[82009]: INFO nova.compute.manager [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Neutron deleted interface 8967a8d4-b607-4572-bfc2-50c7663563cb; detaching it from the instance and deleting it from the info cache
Apr 11 18:13:40 user nova-compute[82009]: DEBUG nova.network.neutron [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:40 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Took 1.48 seconds to deallocate network for instance.
Apr 11 18:13:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-653b2d0f-a852-458c-8d98-b4db768dfba4 req-69ea833c-d980-4ebe-927f-01b3391940c6 service nova] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Detach interface failed, port_id=8967a8d4-b607-4572-bfc2-50c7663563cb, reason: Instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:13:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:40 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:13:40 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:13:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:40 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Deleted allocations for instance 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b
Apr 11 18:13:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-21a689a3-e92f-4c16-94b2-53a627efb506 tempest-TaggedAttachmentsTest-915024626 tempest-TaggedAttachmentsTest-915024626-project-member] Lock "9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.943s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:41 user nova-compute[82009]: INFO nova.compute.manager [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Terminating instance
Apr 11 18:13:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-vif-unplugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] No waiting events found dispatching network-vif-unplugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9754b3f-0ca5-450d-bf35-526f0ec7572a req-6885c5bf-5b40-464e-af9e-50367290e6f7 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-vif-unplugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:13:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Instance destroyed successfully.
Apr 11 18:13:41 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lazy-loading 'resources' on Instance uuid c107e5ac-af58-4702-aa62-253f3424c585 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-410575530',display_name='tempest-TestVolumeSwap-server-410575530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-410575530',id=7,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItze44OHRrzTJBXg4OENnJbauHoiu2rr3GWBqGL/9xCDLTcFJAl0TKCQF1smiP/y4xObggC6qDCPDzTrqWWOTF3SJ0yaeDG4pl0IVe4P1xS4HSXTcR8yMA4STp3p767Q==',key_name='tempest-keypair-1379978453',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19acb9280d2f48b59ad7b2fde0e4efb3',ramdisk_id='',reservation_id='r-3rnkqan0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1807194571',owner_user_name='tempest-TestVolumeSwap-1807194571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6d4a1de4c8e49a0a14eec670db8ff0f',uuid=c107e5ac-af58-4702-aa62-253f3424c585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Converting VIF {"id": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "address": "fa:16:3e:5b:a7:91", "network": {"id": "2307a7f8-7485-4e74-b310-f37dec5e8469", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122160010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19acb9280d2f48b59ad7b2fde0e4efb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8a46ee6-74", "ovs_interfaceid": "c8a46ee6-74bb-42ed-a653-649dc130b0f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG os_vif [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8a46ee6-74, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:13:42 user nova-compute[82009]: INFO os_vif [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=c8a46ee6-74bb-42ed-a653-649dc130b0f3,network=Network(2307a7f8-7485-4e74-b310-f37dec5e8469),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8a46ee6-74')
Apr 11 18:13:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Deleting instance files /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585_del
Apr 11 18:13:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Deletion of /opt/stack/data/nova/instances/c107e5ac-af58-4702-aa62-253f3424c585_del complete
Apr 11 18:13:42 user nova-compute[82009]: INFO nova.compute.manager [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 11 18:13:42 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:13:42 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:43 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Took 1.08 seconds to deallocate network for instance.
Apr 11 18:13:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-0134f73e-2827-4c52-964c-b73a8a0741d1 req-663630d9-9d53-4e74-ba52-4c0d5f1f8931 service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-vif-deleted-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:43 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Deleted allocations for instance c107e5ac-af58-4702-aa62-253f3424c585
Apr 11 18:13:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received event network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Acquiring lock "c107e5ac-af58-4702-aa62-253f3424c585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] Lock "c107e5ac-af58-4702-aa62-253f3424c585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] No waiting events found dispatching network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:43 user nova-compute[82009]: WARNING nova.compute.manager [req-a13e8328-8496-401c-9fdd-f08f56ffcfe4 req-8dee6beb-6079-4cae-afe5-0f5d56ed035c service nova] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Received unexpected event network-vif-plugged-c8a46ee6-74bb-42ed-a653-649dc130b0f3 for instance with vm_state deleted and task_state None.
Apr 11 18:13:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fb2694d1-4f36-440e-9f9d-90a6b6376f63 tempest-TestVolumeSwap-1807194571 tempest-TestVolumeSwap-1807194571-project-member] Lock "c107e5ac-af58-4702-aa62-253f3424c585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.593s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:13:51 user nova-compute[82009]: INFO nova.compute.claims [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Claim successful on node user
Apr 11 18:13:51 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:13:51 user nova-compute[82009]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:52 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:13:52 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Creating image(s)
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "/opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "/opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "/opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.policy [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.181s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk 1073741824" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.176s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Successfully created port: e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Cannot resize image /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.objects.instance [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lazy-loading 'migration_context' on Instance uuid 34ce2adc-e171-42fd-8c28-6359d56f612e {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Ensure instance console log exists: /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236818.7272496, 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:53 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] VM Stopped (Lifecycle Event)
Apr 11 18:13:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4b776a2-4cde-4720-98f3-c2a9e5802eb9 None None] [instance: 9d3c7cc5-68c0-4187-aa9b-8c756bc9e84b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:53 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Successfully updated port: e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "refresh_cache-34ce2adc-e171-42fd-8c28-6359d56f612e" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquired lock "refresh_cache-34ce2adc-e171-42fd-8c28-6359d56f612e" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-changed-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Refreshing instance network info cache due to event network-changed-e3cff827-1068-4b1c-b1d9-e1aba348f9d9. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Acquiring lock "refresh_cache-34ce2adc-e171-42fd-8c28-6359d56f612e" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Updating instance_info_cache with network_info: [{"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Releasing lock "refresh_cache-34ce2adc-e171-42fd-8c28-6359d56f612e" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Instance network_info: |[{"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Acquired lock "refresh_cache-34ce2adc-e171-42fd-8c28-6359d56f612e" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.network.neutron [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Refreshing network info cache for port e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Start _get_guest_xml network_info=[{"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:13:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1899339481',display_name='tempest-VolumesActionsTest-instance-1899339481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1899339481',id=14,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf13b304615f48ab88c64755c2795c99',ramdisk_id='',reservation_id='r-h1g3pb10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1596862779',owner_user_name='tempest-VolumesActionsTest-1596862779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:13:52Z,user_data=None,user_id='086769a77da24d95a54c35f917240664',uuid=34ce2adc-e171-42fd-8c28-6359d56f612e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converting VIF {"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lazy-loading 'pci_devices' on Instance uuid 34ce2adc-e171-42fd-8c28-6359d56f612e {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:13:55 user nova-compute[82009]:   <uuid>34ce2adc-e171-42fd-8c28-6359d56f612e</uuid>
Apr 11 18:13:55 user nova-compute[82009]:   <name>instance-0000000e</name>
Apr 11 18:13:55 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:13:55 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:13:55 user nova-compute[82009]:   <metadata>
Apr 11 18:13:55 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:13:55 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:13:55 user nova-compute[82009]:       <nova:name>tempest-VolumesActionsTest-instance-1899339481</nova:name>
Apr 11 18:13:55 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:13:55</nova:creationTime>
Apr 11 18:13:55 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:13:55 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:13:55 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:13:55 user nova-compute[82009]:       <nova:owner>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:user uuid="086769a77da24d95a54c35f917240664">tempest-VolumesActionsTest-1596862779-project-member</nova:user>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:project uuid="bf13b304615f48ab88c64755c2795c99">tempest-VolumesActionsTest-1596862779</nova:project>
Apr 11 18:13:55 user nova-compute[82009]:       </nova:owner>
Apr 11 18:13:55 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:13:55 user nova-compute[82009]:       <nova:ports>
Apr 11 18:13:55 user nova-compute[82009]:         <nova:port uuid="e3cff827-1068-4b1c-b1d9-e1aba348f9d9">
Apr 11 18:13:55 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:13:55 user nova-compute[82009]:         </nova:port>
Apr 11 18:13:55 user nova-compute[82009]:       </nova:ports>
Apr 11 18:13:55 user nova-compute[82009]:     </nova:instance>
Apr 11 18:13:55 user nova-compute[82009]:   </metadata>
Apr 11 18:13:55 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:13:55 user nova-compute[82009]:     <system>
Apr 11 18:13:55 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:13:55 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:13:55 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:13:55 user nova-compute[82009]:       <entry name="serial">34ce2adc-e171-42fd-8c28-6359d56f612e</entry>
Apr 11 18:13:55 user nova-compute[82009]:       <entry name="uuid">34ce2adc-e171-42fd-8c28-6359d56f612e</entry>
Apr 11 18:13:55 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:13:55 user nova-compute[82009]:     </system>
Apr 11 18:13:55 user nova-compute[82009]:   </sysinfo>
Apr 11 18:13:55 user nova-compute[82009]:   <os>
Apr 11 18:13:55 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:13:55 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:13:55 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:13:55 user nova-compute[82009]:   </os>
Apr 11 18:13:55 user nova-compute[82009]:   <features>
Apr 11 18:13:55 user nova-compute[82009]:     <acpi/>
Apr 11 18:13:55 user nova-compute[82009]:     <apic/>
Apr 11 18:13:55 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:13:55 user nova-compute[82009]:   </features>
Apr 11 18:13:55 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:13:55 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:13:55 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:13:55 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:13:55 user nova-compute[82009]:   </clock>
Apr 11 18:13:55 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:13:55 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:13:55 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:13:55 user nova-compute[82009]:   </cpu>
Apr 11 18:13:55 user nova-compute[82009]:   <devices>
Apr 11 18:13:55 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:13:55 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:13:55 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk"/>
Apr 11 18:13:55 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:13:55 user nova-compute[82009]:     </disk>
Apr 11 18:13:55 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:13:55 user nova-compute[82009]:       <mac address="fa:16:3e:50:22:8a"/>
Apr 11 18:13:55 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:13:55 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:13:55 user nova-compute[82009]:       <target dev="tape3cff827-10"/>
Apr 11 18:13:55 user nova-compute[82009]:     </interface>
Apr 11 18:13:55 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:13:55 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/console.log" append="off"/>
Apr 11 18:13:55 user nova-compute[82009]:     </serial>
Apr 11 18:13:55 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:13:55 user nova-compute[82009]:     <video>
Apr 11 18:13:55 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:13:55 user nova-compute[82009]:     </video>
Apr 11 18:13:55 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:13:55 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:13:55 user nova-compute[82009]:     </rng>
Apr 11 18:13:55 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:13:55 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:13:55 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:13:55 user nova-compute[82009]:     </memballoon>
Apr 11 18:13:55 user nova-compute[82009]:   </devices>
Apr 11 18:13:55 user nova-compute[82009]: </domain>
Apr 11 18:13:55 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1899339481',display_name='tempest-VolumesActionsTest-instance-1899339481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1899339481',id=14,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf13b304615f48ab88c64755c2795c99',ramdisk_id='',reservation_id='r-h1g3pb10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1596862779',owner_user_name='tempest-VolumesActionsTest-1596862779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:13:52Z,user_data=None,user_id='086769a77da24d95a54c35f917240664',uuid=34ce2adc-e171-42fd-8c28-6359d56f612e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converting VIF {"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG os_vif [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'flavor' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3cff827-10, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3cff827-10, col_values=(('external_ids', {'iface-id': 'e3cff827-1068-4b1c-b1d9-e1aba348f9d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:22:8a', 'vm-uuid': '34ce2adc-e171-42fd-8c28-6359d56f612e'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:13:55 user nova-compute[82009]: INFO os_vif [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10')
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] No VIF found with MAC fa:16:3e:50:22:8a, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:56 user nova-compute[82009]: INFO nova.compute.manager [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Attaching volume 7d656453-9ad5-4870-b6af-cf2022addc76 to /dev/vdb
Apr 11 18:13:56 user nova-compute[82009]: DEBUG os_brick.utils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[556bde0d-08ab-40d5-bf9d-868c5aff8eda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4698b2fc-dd07-4e3b-877c-0b99e3193b21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236839.3602707, 34ce2adc-e171-42fd-8c28-6359d56f612e => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] VM Resumed (Lifecycle Event)
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236821.9779487, c107e5ac-af58-4702-aa62-253f3424c585 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:59 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: c107e5ac-af58-4702-aa62-253f3424c585] VM Stopped (Lifecycle Event)
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:59 user nova-compute[82009]: WARNING nova.compute.manager [req-b20d1d3e-5cdb-4e6e-8623-ef4cd57529e6 req-44b3c4e2-781d-483a-b80d-88cc9eb862fd service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state building and task_state spawning.
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:13:59 user nova-compute[82009]: WARNING nova.compute.manager [req-d319e507-93f8-4d68-8204-e203cab329e3 req-d98f532b-db86-4afd-ab7b-08dea798c6eb service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state building and task_state spawning.
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-67f48193-f840-47e1-8777-f8e4aaa1c5ea None None] [instance: c107e5ac-af58-4702-aa62-253f3424c585] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:59 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Instance spawned successfully.
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a79a9d-0545-4217-b1e3-027d05390787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:59 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:59 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=26.632984161376953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[78141ba0-d64e-4a4f-aecd-e3736e9c9246]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:13:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236839.3611002, 34ce2adc-e171-42fd-8c28-6359d56f612e => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:13:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] VM Started (Lifecycle Event)
Apr 11 18:13:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:13:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:14:00 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b0add-74b4-49c3-bd84-8935417778f0]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG os_brick.utils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] <== get_connector_properties: return (3912ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating existing volume attachment record: 7a82ac81-0bd3-41fe-972e-f839554857b4 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:00 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:14:00 user nova-compute[82009]: INFO nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Took 7.90 seconds to spawn the instance on the hypervisor.
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 34ce2adc-e171-42fd-8c28-6359d56f612e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:14:00 user nova-compute[82009]: INFO nova.compute.manager [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Took 8.67 seconds to build instance.
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.network.neutron [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Updated VIF entry in instance network info cache for port e3cff827-1068-4b1c-b1d9-e1aba348f9d9. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.network.neutron [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Updating instance_info_cache with network_info: [{"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-88aa0a92-6ff1-4832-ab2c-0378bf775a6a tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.781s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7ddeb32c-d499-4b97-bd16-da977fd0148e req-26579d93-6a01-4423-a84f-76af8144e0f7 service nova] Releasing lock "refresh_cache-34ce2adc-e171-42fd-8c28-6359d56f612e" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.474s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:14:00 user nova-compute[82009]: INFO nova.compute.claims [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Claim successful on node user
Apr 11 18:14:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:00 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:14:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.policy [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'flavor' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.267s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:14:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Creating image(s)
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "/opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "/opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "/opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:01 user nova-compute[82009]: INFO nova.compute.manager [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attaching volume e18a0321-da20-41e7-b97b-7350ae176fc5 to /dev/vdb
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.175s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG os_brick.utils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5d40a0-73a9-405a-9e11-197ea0ace6a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4bed59-433f-4529-be7b-a0ac182951c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk 1073741824" returned: 0 in 0.063s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[99100e9a-4868-4e4d-b5ae-8581fa9eb07c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6f954-601e-4746-86f3-321e65760f2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:14:02 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13d9105-a68f-477e-9be5-58a7e452fd9d]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG os_brick.utils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating existing volume attachment record: 8a1302b3-5820-462d-bfbe-d51871b4ed0c {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Successfully created port: 8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Cannot resize image /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.objects.instance [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'migration_context' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Ensure instance console log exists: /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Successfully updated port: 8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquired lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-changed-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Refreshing instance network info cache due to event network-changed-8110c1e3-0ed5-46e0-8f26-6c6d00460693. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Acquiring lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.neutron [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating instance_info_cache with network_info: [{"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Releasing lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Instance network_info: |[{"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Acquired lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Refreshing network info cache for port 8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Start _get_guest_xml network_info=[{"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:14:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1603498422',display_name='tempest-VolumesAdminNegativeTest-server-1603498422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1603498422',id=15,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2PgzNFmwBsFUNuQ95xhwKc3ab85OukYflSWY9oEAX8fbv+TSaubOQPFW2shpSVHS5iAGWk+Kf+qNt/RNc14rmRY/3EDWnt360T6Gp6M9r075izLzf0oeIHzGVgNGQ+SA==',key_name='tempest-keypair-581234075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad8dd512b7424fbe996ecbd18d11471e',ramdisk_id='',reservation_id='r-3553quxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-298923704',owner_user_name='tempest-VolumesAdminNegativeTest-298923704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20726e00e3743168e32eafe43318e20',uuid=db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converting VIF {"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'pci_devices' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:14:04 user nova-compute[82009]:   <uuid>db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7</uuid>
Apr 11 18:14:04 user nova-compute[82009]:   <name>instance-0000000f</name>
Apr 11 18:14:04 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:14:04 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:14:04 user nova-compute[82009]:   <metadata>
Apr 11 18:14:04 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:14:04 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:14:04 user nova-compute[82009]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1603498422</nova:name>
Apr 11 18:14:04 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:14:04</nova:creationTime>
Apr 11 18:14:04 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:14:04 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:14:04 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:14:04 user nova-compute[82009]:       <nova:owner>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:user uuid="d20726e00e3743168e32eafe43318e20">tempest-VolumesAdminNegativeTest-298923704-project-member</nova:user>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:project uuid="ad8dd512b7424fbe996ecbd18d11471e">tempest-VolumesAdminNegativeTest-298923704</nova:project>
Apr 11 18:14:04 user nova-compute[82009]:       </nova:owner>
Apr 11 18:14:04 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:14:04 user nova-compute[82009]:       <nova:ports>
Apr 11 18:14:04 user nova-compute[82009]:         <nova:port uuid="8110c1e3-0ed5-46e0-8f26-6c6d00460693">
Apr 11 18:14:04 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:14:04 user nova-compute[82009]:         </nova:port>
Apr 11 18:14:04 user nova-compute[82009]:       </nova:ports>
Apr 11 18:14:04 user nova-compute[82009]:     </nova:instance>
Apr 11 18:14:04 user nova-compute[82009]:   </metadata>
Apr 11 18:14:04 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:14:04 user nova-compute[82009]:     <system>
Apr 11 18:14:04 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:14:04 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:14:04 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:14:04 user nova-compute[82009]:       <entry name="serial">db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7</entry>
Apr 11 18:14:04 user nova-compute[82009]:       <entry name="uuid">db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7</entry>
Apr 11 18:14:04 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:14:04 user nova-compute[82009]:     </system>
Apr 11 18:14:04 user nova-compute[82009]:   </sysinfo>
Apr 11 18:14:04 user nova-compute[82009]:   <os>
Apr 11 18:14:04 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:14:04 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:14:04 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:14:04 user nova-compute[82009]:   </os>
Apr 11 18:14:04 user nova-compute[82009]:   <features>
Apr 11 18:14:04 user nova-compute[82009]:     <acpi/>
Apr 11 18:14:04 user nova-compute[82009]:     <apic/>
Apr 11 18:14:04 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:14:04 user nova-compute[82009]:   </features>
Apr 11 18:14:04 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:14:04 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:14:04 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:14:04 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:14:04 user nova-compute[82009]:   </clock>
Apr 11 18:14:04 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:14:04 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:14:04 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:14:04 user nova-compute[82009]:   </cpu>
Apr 11 18:14:04 user nova-compute[82009]:   <devices>
Apr 11 18:14:04 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:04 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:04 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk"/>
Apr 11 18:14:04 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:14:04 user nova-compute[82009]:     </disk>
Apr 11 18:14:04 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:14:04 user nova-compute[82009]:       <mac address="fa:16:3e:f8:c4:74"/>
Apr 11 18:14:04 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:04 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:14:04 user nova-compute[82009]:       <target dev="tap8110c1e3-0e"/>
Apr 11 18:14:04 user nova-compute[82009]:     </interface>
Apr 11 18:14:04 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:14:04 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/console.log" append="off"/>
Apr 11 18:14:04 user nova-compute[82009]:     </serial>
Apr 11 18:14:04 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:14:04 user nova-compute[82009]:     <video>
Apr 11 18:14:04 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:04 user nova-compute[82009]:     </video>
Apr 11 18:14:04 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:14:04 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:14:04 user nova-compute[82009]:     </rng>
Apr 11 18:14:04 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:14:04 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:14:04 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:14:04 user nova-compute[82009]:     </memballoon>
Apr 11 18:14:04 user nova-compute[82009]:   </devices>
Apr 11 18:14:04 user nova-compute[82009]: </domain>
Apr 11 18:14:04 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1603498422',display_name='tempest-VolumesAdminNegativeTest-server-1603498422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1603498422',id=15,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2PgzNFmwBsFUNuQ95xhwKc3ab85OukYflSWY9oEAX8fbv+TSaubOQPFW2shpSVHS5iAGWk+Kf+qNt/RNc14rmRY/3EDWnt360T6Gp6M9r075izLzf0oeIHzGVgNGQ+SA==',key_name='tempest-keypair-581234075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad8dd512b7424fbe996ecbd18d11471e',ramdisk_id='',reservation_id='r-3553quxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-298923704',owner_user_name='tempest-VolumesAdminNegativeTest-298923704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20726e00e3743168e32eafe43318e20',uuid=db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converting VIF {"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_vif [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8110c1e3-0e, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8110c1e3-0e, col_values=(('external_ids', {'iface-id': '8110c1e3-0ed5-46e0-8f26-6c6d00460693', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:c4:74', 'vm-uuid': 'db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:04 user nova-compute[82009]: INFO os_vif [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e')
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No VIF found with MAC fa:16:3e:f8:c4:74, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updated VIF entry in instance network info cache for port 8110c1e3-0ed5-46e0-8f26-6c6d00460693. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating instance_info_cache with network_info: [{"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bda0874d-b0a5-422c-b9a5-8a3f1585269d req-463fe35c-324b-44be-a65b-2039a19f357d service nova] Releasing lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmXoPbBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:04 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:04 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:04 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4607f9e-31db-4f4e-8ab3-24fa05756870]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:14:04 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8986336-9c2d-4413-8c58-a68122cc75b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76] added
Apr 11 18:14:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87130653-3b34-4e2d-9c65-c78bec69fd6e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e2784f-3733-484f-b28b-8e892e00d5f5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmXoPbBI {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmXoPbBI" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc1aab-af8f-4607-87b9-13e7cf01c106]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmXoPbBI'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a90108f-85f5-45a3-8692-417b9cfa7e03]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0f1c65-8d51-4264-b464-3e151f0fc30b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:05 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:05 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6eadf-e0af-4aa4-9b24-f00bd38c1617]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260]
Apr 11 18:14:05 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260] successful.
Apr 11 18:14:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e3cfe0-4593-4e75-bdc4-113996865800]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.072s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a3fa4a-e710-4406-b443-4dea6756427f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:05 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:05 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:05 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:05 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c3e54-f710-42d1-9f7b-9a3f740b0108]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmXoPbBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] No waiting events found dispatching network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:06 user nova-compute[82009]: WARNING nova.compute.manager [req-60280f34-e1c4-4710-8f4c-c724ba1fc5c3 req-671b7902-ade8-43ce-ab87-11c0a101f15b service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received unexpected event network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance with vm_state building and task_state spawning.
Apr 11 18:14:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '23132633931363966', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132633931363966', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG nova.objects.instance [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'flavor' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:14:06 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:14:06 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:14:06 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:14:06 user nova-compute[82009]:   <serial>7d656453-9ad5-4870-b6af-cf2022addc76</serial>
Apr 11 18:14:06 user nova-compute[82009]: </disk>
Apr 11 18:14:06 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:06 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:06 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:06 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a25cd8-8cd8-4735-9981-c8763d280b2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:14:06 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549fb61-fe19-4b97-a4b3-653a0ac776c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5] added
Apr 11 18:14:06 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c882d3c-407e-4da1-b017-55089b793362]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1190df97-f1c7-4052-9429-088c846ecd30]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrxfaYHO {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrxfaYHO" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[219913bf-85be-4a0b-bc22-a77a605686f1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrxfaYHO'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[197f19a5-36dd-4004-87f5-10240e64aad0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1cb30-e85c-4363-98bf-297c18547972]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No VIF found with MAC fa:16:3e:c5:06:91, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd84c613-0211-44fd-877d-5454f05afd3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]
Apr 11 18:14:07 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.
Apr 11 18:14:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60720c35-26d2-4fc5-90d1-915791fa248c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d377802a-4e7d-419f-afae-af471c7ea661]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f3bd70-736b-407b-9a17-ec7332280d46]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:14:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-138baf1d-8295-462d-97cc-8452c6a1b66f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.333s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236848.111695, db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] VM Resumed (Lifecycle Event)
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] No waiting events found dispatching network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:08 user nova-compute[82009]: WARNING nova.compute.manager [req-9545f355-5618-42fc-b999-04f6d60bdaea req-7ba2c22c-9f9c-4307-bb99-ec88e8158a98 service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received unexpected event network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance with vm_state building and task_state spawning.
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Instance spawned successfully.
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236848.1144125, db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] VM Started (Lifecycle Event)
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Took 6.66 seconds to spawn the instance on the hypervisor.
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23431363239336364', 'path': '/dev/sde'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431363239336364', 'path': '/dev/sde'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'flavor' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:14:08 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:14:08 user nova-compute[82009]:   <source dev="/dev/sde"/>
Apr 11 18:14:08 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:14:08 user nova-compute[82009]:   <serial>e18a0321-da20-41e7-b97b-7350ae176fc5</serial>
Apr 11 18:14:08 user nova-compute[82009]: </disk>
Apr 11 18:14:08 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Took 8.37 seconds to build instance.
Apr 11 18:14:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4b572026-d355-4eef-b735-fa2f8e1a1733 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.504s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:08 user nova-compute[82009]: INFO nova.compute.manager [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Rescuing
Apr 11 18:14:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:fd:e3:b5, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-30e52156-d74a-453f-aee2-a1326e2bd4c7 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.237s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:09 user nova-compute[82009]: WARNING nova.compute.manager [req-f7aec257-40ea-4810-8c67-7b53e78f1dd0 req-d300c76f-5bbb-4373-a428-6fa3bfc24d31 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance destroyed successfully.
Apr 11 18:14:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Attempting a stable device rescue
Apr 11 18:14:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82009) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:14:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Creating image(s)
Apr 11 18:14:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "63861990f2125e992ea37c57cac7e80abb79da4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "63861990f2125e992ea37c57cac7e80abb79da4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:11 user nova-compute[82009]: INFO nova.compute.manager [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Rebuilding instance
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.part --force-share --output=json" returned: 0 in 0.190s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.virt.images [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] 06e3ca91-1344-4d75-bb85-d0666535be8c was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.part /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:11 user nova-compute[82009]: WARNING nova.compute.manager [req-c7ed7fd1-dcd7-4b1d-bb17-7990304ffa7b req-9f2f2310-f864-403f-843e-ec994575e7c7 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_requests' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.part /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.converted" returned: 0 in 0.244s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_devices' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'migration_context' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82009) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 18:14:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "63861990f2125e992ea37c57cac7e80abb79da4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.773s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "63861990f2125e992ea37c57cac7e80abb79da4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "63861990f2125e992ea37c57cac7e80abb79da4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d --force-share --output=json" returned: 0 in 0.177s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d,backing_fmt=raw /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d,backing_fmt=raw /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue" returned: 0 in 0.057s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "63861990f2125e992ea37c57cac7e80abb79da4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'migration_context' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Start _get_guest_xml network_info=[{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "vif_mac": "fa:16:3e:c5:06:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '06e3ca91-1344-4d75-bb85-d0666535be8c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7a82ac81-0bd3-41fe-972e-f839554857b4', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmXoPbBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1f3000ca-5a67-4814-bf9d-94415c8f3d9d', 'attached_at': '', 'detached_at': '', 'volume_id': '7d656453-9ad5-4870-b6af-cf2022addc76', 'serial': '7d656453-9ad5-4870-b6af-cf2022addc76'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'resources' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:12 user nova-compute[82009]: WARNING nova.compute.manager [req-644b11aa-8db6-412d-88fc-6ef6a4436022 req-7a01ea1b-8f77-4d1a-8796-5b524c6c4bc2 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state rebuilding.
Apr 11 18:14:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmXoPbBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:12 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:12 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:12 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0242c2c5-fd5b-49e0-b813-e73c6495001d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RmXoPbBI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 18:14:12 user nova-compute[82009]: node.name = iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:14:12 user nova-compute[82009]: node.tpgt = -1
Apr 11 18:14:12 user nova-compute[82009]: node.startup = automatic
Apr 11 18:14:12 user nova-compute[82009]: node.leading_login = No
Apr 11 18:14:12 user nova-compute[82009]: iface.iscsi_ifacename = default
Apr 11 18:14:12 user nova-compute[82009]: iface.net_ifacename = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.ipaddress = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.prefix_len = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.hwaddress = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.transport_name = tcp
Apr 11 18:14:12 user nova-compute[82009]: iface.initiatorname = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.vlan_id = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.vlan_priority = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.vlan_state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.iface_num = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.mtu = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.port = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.bootproto = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.subnet_mask = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.gateway = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_alt_client_id = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_dns = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_learn_iqn = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_vendor_id_state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_vendor_id = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.dhcp_slp_da = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.fragmentation = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.gratuitous_arp = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.incoming_forwarding = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.tos_state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.tos = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.ttl = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.delayed_ack = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.tcp_nagle = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.tcp_wsf_state = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.tcp_wsf = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.tcp_timer_scale = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.tcp_timestamp = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.redirect = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.def_task_mgmt_timeout = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.header_digest = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.data_digest = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.immediate_data = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.initial_r2t = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.data_seq_inorder = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.data_pdu_inorder = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.erl = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.max_receive_data_len = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.first_burst_len = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.max_outstanding_r2t = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.max_burst_len = 0
Apr 11 18:14:12 user nova-compute[82009]: iface.chap_auth = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.bidi_chap = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.strict_login_compliance = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.discovery_auth = <empty>
Apr 11 18:14:12 user nova-compute[82009]: iface.discovery_logout = <empty>
Apr 11 18:14:12 user nova-compute[82009]: node.discovery_address = <empty>
Apr 11 18:14:12 user nova-compute[82009]: node.discovery_port = 0
Apr 11 18:14:12 user nova-compute[82009]: node.discovery_type = static
Apr 11 18:14:12 user nova-compute[82009]: node.session.initial_cmdsn = 0
Apr 11 18:14:12 user nova-compute[82009]: node.session.initial_login_retry_max = 8
Apr 11 18:14:12 user nova-compute[82009]: node.session.xmit_thread_priority = -20
Apr 11 18:14:12 user nova-compute[82009]: node.session.cmds_max = 128
Apr 11 18:14:12 user nova-compute[82009]: node.session.queue_depth = 32
Apr 11 18:14:12 user nova-compute[82009]: node.session.nr_sessions = 1
Apr 11 18:14:12 user nova-compute[82009]: node.session.auth.authmethod = CHAP
Apr 11 18:14:12 user nova-compute[82009]: node.session.auth.username = RmXoPbBI
Apr 11 18:14:12 user nova-compute[82009]: node.session.auth.password = ***
Apr 11 18:14:12 user nova-compute[82009]: node.session.auth.username_in = <empty>
Apr 11 18:14:12 user nova-compute[82009]: node.session.auth.password_in = <empty>
Apr 11 18:14:12 user nova-compute[82009]: node.session.auth.chap_algs = MD5
Apr 11 18:14:12 user nova-compute[82009]: node.session.timeo.replacement_timeout = 120
Apr 11 18:14:12 user nova-compute[82009]: node.session.err_timeo.abort_timeout = 15
Apr 11 18:14:12 user nova-compute[82009]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 18:14:12 user nova-compute[82009]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 18:14:12 user nova-compute[82009]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.FastAbort = Yes
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.InitialR2T = No
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.ImmediateData = Yes
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.MaxConnections = 1
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 18:14:12 user nova-compute[82009]: node.session.iscsi.ERL = 0
Apr 11 18:14:12 user nova-compute[82009]: node.session.scan = manual
Apr 11 18:14:12 user nova-compute[82009]: node.session.reopen_max = 0
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].address = 172.16.0.220
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].port = 3260
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].startup = manual
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].tcp.window_size = 524288
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].tcp.type_of_service = 0
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].timeo.logout_timeout = 15
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].timeo.login_timeout = 15
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].timeo.auth_timeout = 45
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].iscsi.DataDigest = None
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].iscsi.IFMarker = No
Apr 11 18:14:12 user nova-compute[82009]: node.conn[0].iscsi.OFMarker = No
Apr 11 18:14:12 user nova-compute[82009]: # END RECORD
Apr 11 18:14:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194d9e6-50c8-4632-8382-313841b86df6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[678999c0-4704-4f4b-812b-6e71e61e9abb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmXoPbBI {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmXoPbBI" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97da3fe-a243-4511-bfe8-c54f3f364eda]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmXoPbBI'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[757387d3-869f-4a28-92f8-4a2c0d54e285]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4262c9-8db2-4554-bfe6-a0590d357719]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:12 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:12 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:12 user nova-compute[82009]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:12 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:12 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:12 user nova-compute[82009]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.194s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] HCTL ('35', '0', '0', 0) found on session 17 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0840c39a-a4d2-458c-b5e4-dbaad388212e]: (4, ('0 0 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Searching for a device in session 17 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmXoPbBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.223s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] <== connect_volume: return (225ms) {'type': 'block', 'scsi_wwn': '23132633931363966', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132633931363966', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977485148',display_name='tempest-ServerStableDeviceRescueTest-server-1977485148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977485148',id=5,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfbRQOA+YTKOQ+lZdoJpkrj7VvUUe/6HtKV2apcueDmrB+0261QbqAV8wZxYggyb2JZ0aCJhf8E6yndBbQDy5N2d5vbP3AMf66KfCVAJDPoSHsP3ioPNDUjt3X0FB0lfw==',key_name='tempest-keypair-1352570335',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='964624241aac4d7ba6b2b9ffca6e7d8a',ramdisk_id='',reservation_id='r-vc38xagz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-465398083',owner_user_name='tempest-ServerStableDeviceRescueTest-465398083-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e62201c2b4e4763bae71280d81ff5e4',uuid=1f3000ca-5a67-4814-bf9d-94415c8f3d9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "vif_mac": "fa:16:3e:c5:06:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converting VIF {"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "vif_mac": "fa:16:3e:c5:06:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:14:12 user nova-compute[82009]:   <uuid>1f3000ca-5a67-4814-bf9d-94415c8f3d9d</uuid>
Apr 11 18:14:12 user nova-compute[82009]:   <name>instance-00000005</name>
Apr 11 18:14:12 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:14:12 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:14:12 user nova-compute[82009]:   <metadata>
Apr 11 18:14:12 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:14:12 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:14:12 user nova-compute[82009]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1977485148</nova:name>
Apr 11 18:14:12 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:14:12</nova:creationTime>
Apr 11 18:14:12 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:14:12 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:14:12 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:14:12 user nova-compute[82009]:       <nova:owner>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:user uuid="1e62201c2b4e4763bae71280d81ff5e4">tempest-ServerStableDeviceRescueTest-465398083-project-member</nova:user>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:project uuid="964624241aac4d7ba6b2b9ffca6e7d8a">tempest-ServerStableDeviceRescueTest-465398083</nova:project>
Apr 11 18:14:12 user nova-compute[82009]:       </nova:owner>
Apr 11 18:14:12 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:14:12 user nova-compute[82009]:       <nova:ports>
Apr 11 18:14:12 user nova-compute[82009]:         <nova:port uuid="8be7e2fa-afa5-4bb3-a32b-95a701a17a65">
Apr 11 18:14:12 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 18:14:12 user nova-compute[82009]:         </nova:port>
Apr 11 18:14:12 user nova-compute[82009]:       </nova:ports>
Apr 11 18:14:12 user nova-compute[82009]:     </nova:instance>
Apr 11 18:14:12 user nova-compute[82009]:   </metadata>
Apr 11 18:14:12 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:14:12 user nova-compute[82009]:     <system>
Apr 11 18:14:12 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:14:12 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:14:12 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:14:12 user nova-compute[82009]:       <entry name="serial">1f3000ca-5a67-4814-bf9d-94415c8f3d9d</entry>
Apr 11 18:14:12 user nova-compute[82009]:       <entry name="uuid">1f3000ca-5a67-4814-bf9d-94415c8f3d9d</entry>
Apr 11 18:14:12 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:14:12 user nova-compute[82009]:     </system>
Apr 11 18:14:12 user nova-compute[82009]:   </sysinfo>
Apr 11 18:14:12 user nova-compute[82009]:   <os>
Apr 11 18:14:12 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:14:12 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:14:12 user nova-compute[82009]:   </os>
Apr 11 18:14:12 user nova-compute[82009]:   <features>
Apr 11 18:14:12 user nova-compute[82009]:     <acpi/>
Apr 11 18:14:12 user nova-compute[82009]:     <apic/>
Apr 11 18:14:12 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:14:12 user nova-compute[82009]:   </features>
Apr 11 18:14:12 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:14:12 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:14:12 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:14:12 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:14:12 user nova-compute[82009]:   </clock>
Apr 11 18:14:12 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:14:12 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:14:12 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:14:12 user nova-compute[82009]:   </cpu>
Apr 11 18:14:12 user nova-compute[82009]:   <devices>
Apr 11 18:14:12 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:12 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:12 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk"/>
Apr 11 18:14:12 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:14:12 user nova-compute[82009]:     </disk>
Apr 11 18:14:12 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:14:12 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:14:12 user nova-compute[82009]:       <source dev="/dev/sdd"/>
Apr 11 18:14:12 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:14:12 user nova-compute[82009]:       <serial>7d656453-9ad5-4870-b6af-cf2022addc76</serial>
Apr 11 18:14:12 user nova-compute[82009]:     </disk>
Apr 11 18:14:12 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:12 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:12 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue"/>
Apr 11 18:14:12 user nova-compute[82009]:       <target dev="vdc" bus="virtio"/>
Apr 11 18:14:12 user nova-compute[82009]:       <boot order="1"/>
Apr 11 18:14:12 user nova-compute[82009]:     </disk>
Apr 11 18:14:12 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:14:12 user nova-compute[82009]:       <mac address="fa:16:3e:c5:06:91"/>
Apr 11 18:14:12 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:12 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:14:12 user nova-compute[82009]:       <target dev="tap8be7e2fa-af"/>
Apr 11 18:14:12 user nova-compute[82009]:     </interface>
Apr 11 18:14:12 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:14:12 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/console.log" append="off"/>
Apr 11 18:14:12 user nova-compute[82009]:     </serial>
Apr 11 18:14:12 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:14:12 user nova-compute[82009]:     <video>
Apr 11 18:14:12 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:12 user nova-compute[82009]:     </video>
Apr 11 18:14:12 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:14:12 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:14:12 user nova-compute[82009]:     </rng>
Apr 11 18:14:12 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:14:12 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:14:12 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:14:12 user nova-compute[82009]:     </memballoon>
Apr 11 18:14:12 user nova-compute[82009]:   </devices>
Apr 11 18:14:12 user nova-compute[82009]: </domain>
Apr 11 18:14:12 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:14:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance destroyed successfully.
Apr 11 18:14:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance destroyed successfully.
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] No VIF found with MAC fa:16:3e:c5:06:91, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:12 user nova-compute[82009]: INFO nova.compute.manager [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Detaching volume e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:14:12 user nova-compute[82009]: INFO nova.virt.block_device [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attempting to driver detach volume e18a0321-da20-41e7-b97b-7350ae176fc5 from mountpoint /dev/vdb
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Attempting to detach device vdb from instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:14:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:14:12 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:14:12 user nova-compute[82009]:   <source dev="/dev/sde"/>
Apr 11 18:14:12 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:14:12 user nova-compute[82009]:   <serial>e18a0321-da20-41e7-b97b-7350ae176fc5</serial>
Apr 11 18:14:12 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:14:12 user nova-compute[82009]: </disk>
Apr 11 18:14:12 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:14:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully detached device vdb from instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 from the persistent domain config.
Apr 11 18:14:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:13 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b851277-f339-41e3-93d2-95602a5a10ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:14:13 user nova-compute[82009]: No targets found.
Apr 11 18:14:13 user nova-compute[82009]: iSNS:
Apr 11 18:14:13 user nova-compute[82009]: No targets found.
Apr 11 18:14:13 user nova-compute[82009]: STATIC:
Apr 11 18:14:13 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:14:13 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:13 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:13 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:14:13 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:13 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:13 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:14:13 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:13 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:13 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e
Apr 11 18:14:13 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:13 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:13 user nova-compute[82009]: FIRMWARE:
Apr 11 18:14:13 user nova-compute[82009]: No targets found.
Apr 11 18:14:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:14:13 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:14:13 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cb93a3-d734-4c50-9d90-1eeaeab9a30e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e1fb97-65ea-4675-b7a1-6238cf7f1fa4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:13 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:13 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:13 user nova-compute[82009]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:13 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:13 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:13 user nova-compute[82009]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8244550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5'): ({'sde'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sde {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6809098-4230-4d72-bcc5-76c62553ce00]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87479e66-3af9-420a-bfcf-2b2c06d88242]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sde {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c62c9dd-50c6-4b1b-919f-a21c503b814d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc236c-1b7b-4b86-aef4-840364ad0491]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2a405-34b5-4f12-aa60-3b696a709164]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a8e336-15bb-481a-b729-4e90fe2a78cd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]
Apr 11 18:14:13 user nova-compute[82009]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.
Apr 11 18:14:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcf9364-fb6a-43bb-824f-62af364bf017]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (394ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:14 user nova-compute[82009]: WARNING nova.compute.manager [req-4ec3122f-153d-4114-b067-e9eda94585f0 req-233336e4-6b08-4865-b34c-df970b55d447 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state rebuilding.
Apr 11 18:14:15 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance destroyed successfully.
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cc8035-8d, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: INFO os_vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:15 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d6874-59b7-4fff-bb1c-1123aa426864]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:14:15 user nova-compute[82009]: No targets found.
Apr 11 18:14:15 user nova-compute[82009]: iSNS:
Apr 11 18:14:15 user nova-compute[82009]: No targets found.
Apr 11 18:14:15 user nova-compute[82009]: STATIC:
Apr 11 18:14:15 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:14:15 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:15 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:15 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:14:15 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:15 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:15 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e
Apr 11 18:14:15 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:14:15 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:14:15 user nova-compute[82009]: FIRMWARE:
Apr 11 18:14:15 user nova-compute[82009]: No targets found.
Apr 11 18:14:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:14:15 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:14:15 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fcb72c-80b9-42cb-8d07-203846accd42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b86e31-f9c7-4bab-9aae-ffa834db960a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:15 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:15 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:15 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:15 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:15 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8157760>, {}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (91ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:14:15 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Deleting instance files /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_del
Apr 11 18:14:15 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Deletion of /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_del complete
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:15 user nova-compute[82009]: WARNING nova.compute.manager [req-d1909261-67e5-4c1c-8c96-fcaf8806565f req-6bb7e769-ce63-4260-93df-9ba04d66509d service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:15 user nova-compute[82009]: INFO nova.virt.block_device [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Booting with volume e18a0321-da20-41e7-b97b-7350ae176fc5 at /dev/vdb
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.utils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ab81d-d544-4107-a7a4-6c8a3d7fff09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74307c7f-5728-4096-88c7-ba98834ea4fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1cce6-378a-4eb1-9718-365c6a4a425e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6617f985-ea96-4398-96a1-993dcc807916]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:14:15 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:14:15 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff7283b-4c61-45d8-8bea-1389aeb20b5c]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG os_brick.utils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:15 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating existing volume attachment record: ff465eb3-55f3-4749-b2b8-c91ada915051 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:14:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 1f3000ca-5a67-4814-bf9d-94415c8f3d9d due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236857.0028307, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:17 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Resumed (Lifecycle Event)
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-57bb129d-5504-4faa-b24c-7c37083bc0c0 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:17 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236857.0056567, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:17 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Started (Lifecycle Event)
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:17 user nova-compute[82009]: WARNING nova.compute.manager [req-9b84114b-97ba-4ea5-8abd-6f313510d47b req-a7218c13-3c14-4ec1-bad4-d3415aca4d65 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state rescued and task_state None.
Apr 11 18:14:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:14:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Creating image(s)
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.159s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk 1073741824" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Cannot resize image /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Ensure instance console log exists: /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start _get_guest_xml network_info=[{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ff465eb3-55f3-4749-b2b8-c91ada915051', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1adc9f1d-cc32-446e-9ffc-5fada2383164', 'attached_at': '', 'detached_at': '', 'volume_id': 'e18a0321-da20-41e7-b97b-7350ae176fc5', 'serial': 'e18a0321-da20-41e7-b97b-7350ae176fc5'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:14:21 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 18:14:21 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:14:21 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:21 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:14:21 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa34cfb6-65ac-4d76-aeb1-7a784c23dfb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:14:21 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7827312c-dae3-462d-b63b-6172dbd1ac55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5] added
Apr 11 18:14:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a70c3a-c4ec-4eaf-94f6-1315b9984bbc]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15337784-0896-4508-accf-9da649e8da24]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrxfaYHO {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrxfaYHO" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e89eb78-c312-4baf-81c7-d7a4bfb368d1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrxfaYHO'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c6e68c-fe62-4b52-8bca-5f7bac8b71d9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e71dd-ae52-45a5-ae76-85eabe00af2e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7721bfc5-e446-40dd-8fb5-97b935dee7e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]
Apr 11 18:14:21 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.
Apr 11 18:14:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc86da2-c239-4daf-8415-5472945d3566]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ad97e0-01c1-44ee-ba3d-88b7fdaac2ed]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:14:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235dfe7-aec8-4410-b493-a3c13ea2fd3a]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:14:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23431363239336364', 'path': '/dev/sde'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431363239336364', 'path': '/dev/sde'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:14:22 user nova-compute[82009]:   <uuid>1adc9f1d-cc32-446e-9ffc-5fada2383164</uuid>
Apr 11 18:14:22 user nova-compute[82009]:   <name>instance-00000006</name>
Apr 11 18:14:22 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:14:22 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:14:22 user nova-compute[82009]:   <metadata>
Apr 11 18:14:22 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:14:22 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:14:22 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-731201773</nova:name>
Apr 11 18:14:22 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:14:21</nova:creationTime>
Apr 11 18:14:22 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:14:22 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:14:22 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:14:22 user nova-compute[82009]:       <nova:owner>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:14:22 user nova-compute[82009]:       </nova:owner>
Apr 11 18:14:22 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:14:22 user nova-compute[82009]:       <nova:ports>
Apr 11 18:14:22 user nova-compute[82009]:         <nova:port uuid="98cc8035-8d3e-47cf-9758-c7172120ac70">
Apr 11 18:14:22 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:14:22 user nova-compute[82009]:         </nova:port>
Apr 11 18:14:22 user nova-compute[82009]:       </nova:ports>
Apr 11 18:14:22 user nova-compute[82009]:     </nova:instance>
Apr 11 18:14:22 user nova-compute[82009]:   </metadata>
Apr 11 18:14:22 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:14:22 user nova-compute[82009]:     <system>
Apr 11 18:14:22 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:14:22 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:14:22 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:14:22 user nova-compute[82009]:       <entry name="serial">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:14:22 user nova-compute[82009]:       <entry name="uuid">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:14:22 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:14:22 user nova-compute[82009]:     </system>
Apr 11 18:14:22 user nova-compute[82009]:   </sysinfo>
Apr 11 18:14:22 user nova-compute[82009]:   <os>
Apr 11 18:14:22 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:14:22 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:14:22 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:14:22 user nova-compute[82009]:   </os>
Apr 11 18:14:22 user nova-compute[82009]:   <features>
Apr 11 18:14:22 user nova-compute[82009]:     <acpi/>
Apr 11 18:14:22 user nova-compute[82009]:     <apic/>
Apr 11 18:14:22 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:14:22 user nova-compute[82009]:   </features>
Apr 11 18:14:22 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:14:22 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:14:22 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:14:22 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:14:22 user nova-compute[82009]:   </clock>
Apr 11 18:14:22 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:14:22 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:14:22 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:14:22 user nova-compute[82009]:   </cpu>
Apr 11 18:14:22 user nova-compute[82009]:   <devices>
Apr 11 18:14:22 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:22 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:22 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk"/>
Apr 11 18:14:22 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:14:22 user nova-compute[82009]:     </disk>
Apr 11 18:14:22 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:14:22 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:14:22 user nova-compute[82009]:       <source dev="/dev/sde"/>
Apr 11 18:14:22 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:14:22 user nova-compute[82009]:       <serial>e18a0321-da20-41e7-b97b-7350ae176fc5</serial>
Apr 11 18:14:22 user nova-compute[82009]:     </disk>
Apr 11 18:14:22 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:14:22 user nova-compute[82009]:       <mac address="fa:16:3e:fd:e3:b5"/>
Apr 11 18:14:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:22 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:14:22 user nova-compute[82009]:       <target dev="tap98cc8035-8d"/>
Apr 11 18:14:22 user nova-compute[82009]:     </interface>
Apr 11 18:14:22 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:14:22 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log" append="off"/>
Apr 11 18:14:22 user nova-compute[82009]:     </serial>
Apr 11 18:14:22 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:14:22 user nova-compute[82009]:     <video>
Apr 11 18:14:22 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:22 user nova-compute[82009]:     </video>
Apr 11 18:14:22 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:14:22 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:14:22 user nova-compute[82009]:     </rng>
Apr 11 18:14:22 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:14:22 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:14:22 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:14:22 user nova-compute[82009]:     </memballoon>
Apr 11 18:14:22 user nova-compute[82009]:   </devices>
Apr 11 18:14:22 user nova-compute[82009]: </domain>
Apr 11 18:14:22 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG os_vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cc8035-8d, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98cc8035-8d, col_values=(('external_ids', {'iface-id': '98cc8035-8d3e-47cf-9758-c7172120ac70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e3:b5', 'vm-uuid': '1adc9f1d-cc32-446e-9ffc-5fada2383164'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:22 user nova-compute[82009]: INFO os_vif [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:fd:e3:b5, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:24 user nova-compute[82009]: WARNING nova.compute.manager [req-0968b62f-de63-4e80-80ac-018031c4fec1 req-c58fccf2-1b30-4cf7-930a-2b912405a717 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 18:14:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 1adc9f1d-cc32-446e-9ffc-5fada2383164 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236866.6604471, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Resumed (Lifecycle Event)
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:14:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance spawned successfully.
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:26 user nova-compute[82009]: WARNING nova.compute.manager [req-799ea9e5-12cb-4047-99c4-3bc8133a389c req-7ad2d91a-9c8f-44f9-a9db-b95620fa7b96 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236866.662362, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Started (Lifecycle Event)
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 18:14:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG nova.objects.instance [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82009) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-659ff030-5811-4df9-bfad-5d9f46c77d37 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.098s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:14:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:14:40 user nova-compute[82009]: INFO nova.compute.claims [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Claim successful on node user
Apr 11 18:14:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:14:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:14:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Creating image(s)
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "/opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "/opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "/opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG nova.policy [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c4a8dda134b46e4bd1ebf41c01cf218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a391811fbc45a4a36f4fa1a63cee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.173s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.179s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk 1073741824" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Cannot resize image /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lazy-loading 'migration_context' on Instance uuid 311f2066-14ca-4e4a-b475-7b4314dd45fe {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Ensure instance console log exists: /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Successfully created port: 9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:14:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Successfully updated port: 9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "refresh_cache-311f2066-14ca-4e4a-b475-7b4314dd45fe" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquired lock "refresh_cache-311f2066-14ca-4e4a-b475-7b4314dd45fe" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-changed-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Refreshing instance network info cache due to event network-changed-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Acquiring lock "refresh_cache-311f2066-14ca-4e4a-b475-7b4314dd45fe" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Updating instance_info_cache with network_info: [{"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Releasing lock "refresh_cache-311f2066-14ca-4e4a-b475-7b4314dd45fe" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Instance network_info: |[{"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Acquired lock "refresh_cache-311f2066-14ca-4e4a-b475-7b4314dd45fe" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.neutron [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Refreshing network info cache for port 9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Start _get_guest_xml network_info=[{"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:14:43 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:43 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-951270215',display_name='tempest-VolumesNegativeTest-instance-951270215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-951270215',id=16,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a391811fbc45a4a36f4fa1a63cee7f',ramdisk_id='',reservation_id='r-tc7zkxtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-197324575',owner_user_name='tempest-VolumesNegativeTest-197324575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:41Z,user_data=None,user_id='0c4a8dda134b46e4bd1ebf41c01cf218',uuid=311f2066-14ca-4e4a-b475-7b4314dd45fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Converting VIF {"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lazy-loading 'pci_devices' on Instance uuid 311f2066-14ca-4e4a-b475-7b4314dd45fe {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:14:43 user nova-compute[82009]:   <uuid>311f2066-14ca-4e4a-b475-7b4314dd45fe</uuid>
Apr 11 18:14:43 user nova-compute[82009]:   <name>instance-00000010</name>
Apr 11 18:14:43 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:14:43 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:14:43 user nova-compute[82009]:   <metadata>
Apr 11 18:14:43 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:14:43 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:14:43 user nova-compute[82009]:       <nova:name>tempest-VolumesNegativeTest-instance-951270215</nova:name>
Apr 11 18:14:43 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:14:43</nova:creationTime>
Apr 11 18:14:43 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:14:43 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:14:43 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:14:43 user nova-compute[82009]:       <nova:owner>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:user uuid="0c4a8dda134b46e4bd1ebf41c01cf218">tempest-VolumesNegativeTest-197324575-project-member</nova:user>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:project uuid="d6a391811fbc45a4a36f4fa1a63cee7f">tempest-VolumesNegativeTest-197324575</nova:project>
Apr 11 18:14:43 user nova-compute[82009]:       </nova:owner>
Apr 11 18:14:43 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:14:43 user nova-compute[82009]:       <nova:ports>
Apr 11 18:14:43 user nova-compute[82009]:         <nova:port uuid="9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6">
Apr 11 18:14:43 user nova-compute[82009]:           <nova:ip type="fixed" address="192.168.233.172" ipVersion="4"/>
Apr 11 18:14:43 user nova-compute[82009]:         </nova:port>
Apr 11 18:14:43 user nova-compute[82009]:       </nova:ports>
Apr 11 18:14:43 user nova-compute[82009]:     </nova:instance>
Apr 11 18:14:43 user nova-compute[82009]:   </metadata>
Apr 11 18:14:43 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:14:43 user nova-compute[82009]:     <system>
Apr 11 18:14:43 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:14:43 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:14:43 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:14:43 user nova-compute[82009]:       <entry name="serial">311f2066-14ca-4e4a-b475-7b4314dd45fe</entry>
Apr 11 18:14:43 user nova-compute[82009]:       <entry name="uuid">311f2066-14ca-4e4a-b475-7b4314dd45fe</entry>
Apr 11 18:14:43 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:14:43 user nova-compute[82009]:     </system>
Apr 11 18:14:43 user nova-compute[82009]:   </sysinfo>
Apr 11 18:14:43 user nova-compute[82009]:   <os>
Apr 11 18:14:43 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:14:43 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:14:43 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:14:43 user nova-compute[82009]:   </os>
Apr 11 18:14:43 user nova-compute[82009]:   <features>
Apr 11 18:14:43 user nova-compute[82009]:     <acpi/>
Apr 11 18:14:43 user nova-compute[82009]:     <apic/>
Apr 11 18:14:43 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:14:43 user nova-compute[82009]:   </features>
Apr 11 18:14:43 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:14:43 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:14:43 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:14:43 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:14:43 user nova-compute[82009]:   </clock>
Apr 11 18:14:43 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:14:43 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:14:43 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:14:43 user nova-compute[82009]:   </cpu>
Apr 11 18:14:43 user nova-compute[82009]:   <devices>
Apr 11 18:14:43 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:43 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:43 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk"/>
Apr 11 18:14:43 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:14:43 user nova-compute[82009]:     </disk>
Apr 11 18:14:43 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:14:43 user nova-compute[82009]:       <mac address="fa:16:3e:47:d0:2b"/>
Apr 11 18:14:43 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:43 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:14:43 user nova-compute[82009]:       <target dev="tap9b50ddea-df"/>
Apr 11 18:14:43 user nova-compute[82009]:     </interface>
Apr 11 18:14:43 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:14:43 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/console.log" append="off"/>
Apr 11 18:14:43 user nova-compute[82009]:     </serial>
Apr 11 18:14:43 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:14:43 user nova-compute[82009]:     <video>
Apr 11 18:14:43 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:43 user nova-compute[82009]:     </video>
Apr 11 18:14:43 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:14:43 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:14:43 user nova-compute[82009]:     </rng>
Apr 11 18:14:43 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:14:43 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:14:43 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:14:43 user nova-compute[82009]:     </memballoon>
Apr 11 18:14:43 user nova-compute[82009]:   </devices>
Apr 11 18:14:43 user nova-compute[82009]: </domain>
Apr 11 18:14:43 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-951270215',display_name='tempest-VolumesNegativeTest-instance-951270215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-951270215',id=16,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a391811fbc45a4a36f4fa1a63cee7f',ramdisk_id='',reservation_id='r-tc7zkxtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-197324575',owner_user_name='tempest-VolumesNegativeTest-197324575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:41Z,user_data=None,user_id='0c4a8dda134b46e4bd1ebf41c01cf218',uuid=311f2066-14ca-4e4a-b475-7b4314dd45fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Converting VIF {"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG os_vif [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b50ddea-df, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b50ddea-df, col_values=(('external_ids', {'iface-id': '9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d0:2b', 'vm-uuid': '311f2066-14ca-4e4a-b475-7b4314dd45fe'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:14:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:43 user nova-compute[82009]: INFO os_vif [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df')
Apr 11 18:14:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] No VIF found with MAC fa:16:3e:47:d0:2b, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:44 user nova-compute[82009]: DEBUG nova.network.neutron [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Updated VIF entry in instance network info cache for port 9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:14:44 user nova-compute[82009]: DEBUG nova.network.neutron [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Updating instance_info_cache with network_info: [{"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-25145a2a-9650-49a4-81b5-084c0da561c5 req-60db6489-4f3f-4efa-ae53-4fd378cdde2e service nova] Releasing lock "refresh_cache-311f2066-14ca-4e4a-b475-7b4314dd45fe" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:45 user nova-compute[82009]: WARNING nova.compute.manager [req-79f7d2dc-5bee-4eda-aa0d-aeeb0166d948 req-b27317c3-a8f8-41f9-84bc-901c6a01072c service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received unexpected event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with vm_state building and task_state spawning.
Apr 11 18:14:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:46 user nova-compute[82009]: INFO nova.compute.manager [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Rescuing
Apr 11 18:14:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:46 user nova-compute[82009]: DEBUG nova.network.neutron [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:14:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.network.neutron [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:47 user nova-compute[82009]: WARNING nova.compute.manager [req-b67df060-1aff-4d3b-b1f1-a595cf413938 req-ad90fbd8-fc15-44f2-b1c7-859e16e7a97e service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:47 user nova-compute[82009]: WARNING nova.compute.manager [req-3312b153-8a93-4e4d-bc2b-cfbdf796464c req-c0f8a6fe-5d0c-46e9-9f4d-a99aaba79df2 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received unexpected event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with vm_state building and task_state spawning.
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236887.8877358, 311f2066-14ca-4e4a-b475-7b4314dd45fe => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:47 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] VM Resumed (Lifecycle Event)
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:14:47 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Instance spawned successfully.
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:47 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:14:47 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236887.8947415, 311f2066-14ca-4e4a-b475-7b4314dd45fe => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:47 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] VM Started (Lifecycle Event)
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Took 6.56 seconds to spawn the instance on the hypervisor.
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance destroyed successfully.
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Attempting rescue
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82009) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Creating image(s)
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'trusted_certs' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.compute.manager [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Took 7.61 seconds to build instance.
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c0ba598-6908-4211-852d-d34e37e89555 tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.748s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'migration_context' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Start _get_guest_xml network_info=[{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:d9:29:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'resources' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'numa_topology' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:48 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:48 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1892408024',display_name='tempest-ServerRescueNegativeTestJSON-server-1892408024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1892408024',id=1,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xt0f3of7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:10:24Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=253a1b67-06b0-4308-a2fc-78f36cda0ab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:d9:29:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:d9:29:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'pci_devices' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:14:48 user nova-compute[82009]:   <uuid>253a1b67-06b0-4308-a2fc-78f36cda0ab8</uuid>
Apr 11 18:14:48 user nova-compute[82009]:   <name>instance-00000001</name>
Apr 11 18:14:48 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:14:48 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:14:48 user nova-compute[82009]:   <metadata>
Apr 11 18:14:48 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:14:48 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:14:48 user nova-compute[82009]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1892408024</nova:name>
Apr 11 18:14:48 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:14:48</nova:creationTime>
Apr 11 18:14:48 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:14:48 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:14:48 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:14:48 user nova-compute[82009]:       <nova:owner>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:user uuid="908e0b5a1ce14f5cb636eda79ac77f7b">tempest-ServerRescueNegativeTestJSON-223229619-project-member</nova:user>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:project uuid="c10b5a531bbc41d680d137a766a8b2d9">tempest-ServerRescueNegativeTestJSON-223229619</nova:project>
Apr 11 18:14:48 user nova-compute[82009]:       </nova:owner>
Apr 11 18:14:48 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:14:48 user nova-compute[82009]:       <nova:ports>
Apr 11 18:14:48 user nova-compute[82009]:         <nova:port uuid="3097aae4-0511-4a73-883d-3366bfa914b7">
Apr 11 18:14:48 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:14:48 user nova-compute[82009]:         </nova:port>
Apr 11 18:14:48 user nova-compute[82009]:       </nova:ports>
Apr 11 18:14:48 user nova-compute[82009]:     </nova:instance>
Apr 11 18:14:48 user nova-compute[82009]:   </metadata>
Apr 11 18:14:48 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:14:48 user nova-compute[82009]:     <system>
Apr 11 18:14:48 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:14:48 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:14:48 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:14:48 user nova-compute[82009]:       <entry name="serial">253a1b67-06b0-4308-a2fc-78f36cda0ab8</entry>
Apr 11 18:14:48 user nova-compute[82009]:       <entry name="uuid">253a1b67-06b0-4308-a2fc-78f36cda0ab8</entry>
Apr 11 18:14:48 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:14:48 user nova-compute[82009]:     </system>
Apr 11 18:14:48 user nova-compute[82009]:   </sysinfo>
Apr 11 18:14:48 user nova-compute[82009]:   <os>
Apr 11 18:14:48 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:14:48 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:14:48 user nova-compute[82009]:   </os>
Apr 11 18:14:48 user nova-compute[82009]:   <features>
Apr 11 18:14:48 user nova-compute[82009]:     <acpi/>
Apr 11 18:14:48 user nova-compute[82009]:     <apic/>
Apr 11 18:14:48 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:14:48 user nova-compute[82009]:   </features>
Apr 11 18:14:48 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:14:48 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:14:48 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:14:48 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:14:48 user nova-compute[82009]:   </clock>
Apr 11 18:14:48 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:14:48 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:14:48 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:14:48 user nova-compute[82009]:   </cpu>
Apr 11 18:14:48 user nova-compute[82009]:   <devices>
Apr 11 18:14:48 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:48 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:48 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue"/>
Apr 11 18:14:48 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:14:48 user nova-compute[82009]:     </disk>
Apr 11 18:14:48 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:14:48 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:14:48 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk"/>
Apr 11 18:14:48 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:14:48 user nova-compute[82009]:     </disk>
Apr 11 18:14:48 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:14:48 user nova-compute[82009]:       <mac address="fa:16:3e:d9:29:78"/>
Apr 11 18:14:48 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:48 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:14:48 user nova-compute[82009]:       <target dev="tap3097aae4-05"/>
Apr 11 18:14:48 user nova-compute[82009]:     </interface>
Apr 11 18:14:48 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:14:48 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/console.log" append="off"/>
Apr 11 18:14:48 user nova-compute[82009]:     </serial>
Apr 11 18:14:48 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:14:48 user nova-compute[82009]:     <video>
Apr 11 18:14:48 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:14:48 user nova-compute[82009]:     </video>
Apr 11 18:14:48 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:14:48 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:14:48 user nova-compute[82009]:     </rng>
Apr 11 18:14:48 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:14:48 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:14:48 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:14:48 user nova-compute[82009]:     </memballoon>
Apr 11 18:14:48 user nova-compute[82009]:   </devices>
Apr 11 18:14:48 user nova-compute[82009]: </domain>
Apr 11 18:14:48 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:14:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance destroyed successfully.
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:d9:29:78, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:14:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:49 user nova-compute[82009]: WARNING nova.compute.manager [req-27924664-37b3-4acb-8ff4-12d6d7aa3659 req-cfd1c41b-55ff-4372-938b-90cd4d3f53d9 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:51 user nova-compute[82009]: WARNING nova.compute.manager [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:51 user nova-compute[82009]: DEBUG nova.compute.manager [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:14:51 user nova-compute[82009]: WARNING nova.compute.manager [req-48f2403e-9338-4e86-b0f0-8fa7442c4895 req-d4737ed5-8851-4984-8389-2d85041585a6 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state active and task_state rescuing.
Apr 11 18:14:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 253a1b67-06b0-4308-a2fc-78f36cda0ab8 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236892.7118988, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Resumed (Lifecycle Event)
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-6a244064-b1c3-498b-90ce-2aa119c00c01 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236892.7121642, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:14:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Started (Lifecycle Event)
Apr 11 18:14:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:14:56 user nova-compute[82009]: INFO nova.compute.claims [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Claim successful on node user
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:14:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.policy [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:14:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Creating image(s)
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.177s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.164s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk 1073741824" returned: 0 in 0.066s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Successfully created port: 73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Cannot resize image /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.objects.instance [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'migration_context' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Ensure instance console log exists: /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:14:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Successfully updated port: 73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-changed-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Refreshing instance network info cache due to event network-changed-73d8e6ed-570b-444e-a062-22d66314138a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Acquiring lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Acquired lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.network.neutron [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Refreshing network info cache for port 73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:14:59 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:59 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7596MB free_disk=26.48812484741211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.network.neutron [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 34ce2adc-e171-42fd-8c28-6359d56f612e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.network.neutron [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5125fa7-51a2-4897-91af-0bbf8edc1085 req-8aa5c156-89d7-4438-af3e-f7f34ca9e7c8 service nova] Releasing lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquired lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:14:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Releasing lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance network_info: |[{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start _get_guest_xml network_info=[{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:15:00 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:00 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'pci_devices' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:15:00 user nova-compute[82009]:   <uuid>e7908f28-28c2-4b9a-b804-042f0d186691</uuid>
Apr 11 18:15:00 user nova-compute[82009]:   <name>instance-00000011</name>
Apr 11 18:15:00 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:15:00 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:15:00 user nova-compute[82009]:   <metadata>
Apr 11 18:15:00 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:15:00 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:15:00 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeTestJSON-server-977045182</nova:name>
Apr 11 18:15:00 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:15:00</nova:creationTime>
Apr 11 18:15:00 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:15:00 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:15:00 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:15:00 user nova-compute[82009]:       <nova:owner>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:user uuid="b852c50aeb514b7fbe5a9b72e8bbdc14">tempest-AttachVolumeTestJSON-369540173-project-member</nova:user>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:project uuid="d77a56502d9848a3842c938d5adc8c51">tempest-AttachVolumeTestJSON-369540173</nova:project>
Apr 11 18:15:00 user nova-compute[82009]:       </nova:owner>
Apr 11 18:15:00 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:15:00 user nova-compute[82009]:       <nova:ports>
Apr 11 18:15:00 user nova-compute[82009]:         <nova:port uuid="73d8e6ed-570b-444e-a062-22d66314138a">
Apr 11 18:15:00 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:15:00 user nova-compute[82009]:         </nova:port>
Apr 11 18:15:00 user nova-compute[82009]:       </nova:ports>
Apr 11 18:15:00 user nova-compute[82009]:     </nova:instance>
Apr 11 18:15:00 user nova-compute[82009]:   </metadata>
Apr 11 18:15:00 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:15:00 user nova-compute[82009]:     <system>
Apr 11 18:15:00 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:15:00 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:15:00 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:15:00 user nova-compute[82009]:       <entry name="serial">e7908f28-28c2-4b9a-b804-042f0d186691</entry>
Apr 11 18:15:00 user nova-compute[82009]:       <entry name="uuid">e7908f28-28c2-4b9a-b804-042f0d186691</entry>
Apr 11 18:15:00 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:15:00 user nova-compute[82009]:     </system>
Apr 11 18:15:00 user nova-compute[82009]:   </sysinfo>
Apr 11 18:15:00 user nova-compute[82009]:   <os>
Apr 11 18:15:00 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:15:00 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:15:00 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:15:00 user nova-compute[82009]:   </os>
Apr 11 18:15:00 user nova-compute[82009]:   <features>
Apr 11 18:15:00 user nova-compute[82009]:     <acpi/>
Apr 11 18:15:00 user nova-compute[82009]:     <apic/>
Apr 11 18:15:00 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:15:00 user nova-compute[82009]:   </features>
Apr 11 18:15:00 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:15:00 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:15:00 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:15:00 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:15:00 user nova-compute[82009]:   </clock>
Apr 11 18:15:00 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:15:00 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:15:00 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:15:00 user nova-compute[82009]:   </cpu>
Apr 11 18:15:00 user nova-compute[82009]:   <devices>
Apr 11 18:15:00 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:15:00 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:15:00 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk"/>
Apr 11 18:15:00 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:15:00 user nova-compute[82009]:     </disk>
Apr 11 18:15:00 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:15:00 user nova-compute[82009]:       <mac address="fa:16:3e:8b:69:25"/>
Apr 11 18:15:00 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:15:00 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:15:00 user nova-compute[82009]:       <target dev="tap73d8e6ed-57"/>
Apr 11 18:15:00 user nova-compute[82009]:     </interface>
Apr 11 18:15:00 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:15:00 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/console.log" append="off"/>
Apr 11 18:15:00 user nova-compute[82009]:     </serial>
Apr 11 18:15:00 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:15:00 user nova-compute[82009]:     <video>
Apr 11 18:15:00 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:15:00 user nova-compute[82009]:     </video>
Apr 11 18:15:00 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:15:00 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:15:00 user nova-compute[82009]:     </rng>
Apr 11 18:15:00 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:15:00 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:15:00 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:15:00 user nova-compute[82009]:     </memballoon>
Apr 11 18:15:00 user nova-compute[82009]:   </devices>
Apr 11 18:15:00 user nova-compute[82009]: </domain>
Apr 11 18:15:00 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG os_vif [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73d8e6ed-57, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73d8e6ed-57, col_values=(('external_ids', {'iface-id': '73d8e6ed-570b-444e-a062-22d66314138a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:69:25', 'vm-uuid': 'e7908f28-28c2-4b9a-b804-042f0d186691'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:00 user nova-compute[82009]: INFO os_vif [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57')
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:15:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No VIF found with MAC fa:16:3e:8b:69:25, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:15:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:02 user nova-compute[82009]: WARNING nova.compute.manager [req-0f620f48-e070-43a4-981d-db6a9cab5002 req-a77a40bc-77f3-4739-be10-6c299d195f8e service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state building and task_state spawning.
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:15:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:03 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:15:03 user nova-compute[82009]: INFO nova.compute.claims [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Claim successful on node user
Apr 11 18:15:03 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Creating image(s)
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236904.3689928, e7908f28-28c2-4b9a-b804-042f0d186691 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Resumed (Lifecycle Event)
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance spawned successfully.
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.policy [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:04 user nova-compute[82009]: WARNING nova.compute.manager [req-5e0f15f7-db88-4cda-bdc4-7ee7a8105556 req-4b95ee25-10a3-44c5-a0c5-9c718b6a4119 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state building and task_state spawning.
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236904.3701158, e7908f28-28c2-4b9a-b804-042f0d186691 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Started (Lifecycle Event)
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Took 7.04 seconds to spawn the instance on the hypervisor.
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk 1073741824" returned: 0 in 0.067s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:04 user nova-compute[82009]: INFO nova.compute.manager [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Took 8.36 seconds to build instance.
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-868d17ac-21bf-4f06-8cc9-58630cff7271 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.527s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.163s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Cannot resize image /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:15:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'migration_context' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Ensure instance console log exists: /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Successfully created port: f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:15:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Successfully updated port: f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing instance network info cache due to event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance network_info: |[{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Start _get_guest_xml network_info=[{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:15:06 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:06 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1005799066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1005799066',id=18,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9a9nPmAjerdldl6YPoScXwpgamwr3rJP1TIHx991AR4t6+N4RmymMGiHE3v2lIBtDFvIO76lEEbpVn4KSmVi5IAdIIF3VrPq8fW57dXsGj5RDaIQss3YEolDQ5cNSocQ==',key_name='tempest-keypair-504297625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-i8mh72dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=582e004b-a2f3-4397-9ccb-d23f5724ebe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'pci_devices' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:15:06 user nova-compute[82009]:   <uuid>582e004b-a2f3-4397-9ccb-d23f5724ebe1</uuid>
Apr 11 18:15:06 user nova-compute[82009]:   <name>instance-00000012</name>
Apr 11 18:15:06 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:15:06 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:15:06 user nova-compute[82009]:   <metadata>
Apr 11 18:15:06 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:15:06 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:15:06 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1005799066</nova:name>
Apr 11 18:15:06 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:15:06</nova:creationTime>
Apr 11 18:15:06 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:15:06 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:15:06 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:15:06 user nova-compute[82009]:       <nova:owner>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:user uuid="b724859b7dcd4fd29f17bbf991e9f6d4">tempest-AttachVolumeShelveTestJSON-93672654-project-member</nova:user>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:project uuid="0ed92c60cf9644b5ba5cefd2e92df3e0">tempest-AttachVolumeShelveTestJSON-93672654</nova:project>
Apr 11 18:15:06 user nova-compute[82009]:       </nova:owner>
Apr 11 18:15:06 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:15:06 user nova-compute[82009]:       <nova:ports>
Apr 11 18:15:06 user nova-compute[82009]:         <nova:port uuid="f85d33cf-427d-4b1c-ac2a-da35c15cdb90">
Apr 11 18:15:06 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 18:15:06 user nova-compute[82009]:         </nova:port>
Apr 11 18:15:06 user nova-compute[82009]:       </nova:ports>
Apr 11 18:15:06 user nova-compute[82009]:     </nova:instance>
Apr 11 18:15:06 user nova-compute[82009]:   </metadata>
Apr 11 18:15:06 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:15:06 user nova-compute[82009]:     <system>
Apr 11 18:15:06 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:15:06 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:15:06 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:15:06 user nova-compute[82009]:       <entry name="serial">582e004b-a2f3-4397-9ccb-d23f5724ebe1</entry>
Apr 11 18:15:06 user nova-compute[82009]:       <entry name="uuid">582e004b-a2f3-4397-9ccb-d23f5724ebe1</entry>
Apr 11 18:15:06 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:15:06 user nova-compute[82009]:     </system>
Apr 11 18:15:06 user nova-compute[82009]:   </sysinfo>
Apr 11 18:15:06 user nova-compute[82009]:   <os>
Apr 11 18:15:06 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:15:06 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:15:06 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:15:06 user nova-compute[82009]:   </os>
Apr 11 18:15:06 user nova-compute[82009]:   <features>
Apr 11 18:15:06 user nova-compute[82009]:     <acpi/>
Apr 11 18:15:06 user nova-compute[82009]:     <apic/>
Apr 11 18:15:06 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:15:06 user nova-compute[82009]:   </features>
Apr 11 18:15:06 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:15:06 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:15:06 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:15:06 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:15:06 user nova-compute[82009]:   </clock>
Apr 11 18:15:06 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:15:06 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:15:06 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:15:06 user nova-compute[82009]:   </cpu>
Apr 11 18:15:06 user nova-compute[82009]:   <devices>
Apr 11 18:15:06 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:15:06 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:15:06 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk"/>
Apr 11 18:15:06 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:15:06 user nova-compute[82009]:     </disk>
Apr 11 18:15:06 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:15:06 user nova-compute[82009]:       <mac address="fa:16:3e:80:b4:71"/>
Apr 11 18:15:06 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:15:06 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:15:06 user nova-compute[82009]:       <target dev="tapf85d33cf-42"/>
Apr 11 18:15:06 user nova-compute[82009]:     </interface>
Apr 11 18:15:06 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:15:06 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/console.log" append="off"/>
Apr 11 18:15:06 user nova-compute[82009]:     </serial>
Apr 11 18:15:06 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:15:06 user nova-compute[82009]:     <video>
Apr 11 18:15:06 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:15:06 user nova-compute[82009]:     </video>
Apr 11 18:15:06 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:15:06 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:15:06 user nova-compute[82009]:     </rng>
Apr 11 18:15:06 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:15:06 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:15:06 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:15:06 user nova-compute[82009]:     </memballoon>
Apr 11 18:15:06 user nova-compute[82009]:   </devices>
Apr 11 18:15:06 user nova-compute[82009]: </domain>
Apr 11 18:15:06 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1005799066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1005799066',id=18,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9a9nPmAjerdldl6YPoScXwpgamwr3rJP1TIHx991AR4t6+N4RmymMGiHE3v2lIBtDFvIO76lEEbpVn4KSmVi5IAdIIF3VrPq8fW57dXsGj5RDaIQss3YEolDQ5cNSocQ==',key_name='tempest-keypair-504297625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-i8mh72dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=582e004b-a2f3-4397-9ccb-d23f5724ebe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG os_vif [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85d33cf-42, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf85d33cf-42, col_values=(('external_ids', {'iface-id': 'f85d33cf-427d-4b1c-ac2a-da35c15cdb90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:b4:71', 'vm-uuid': '582e004b-a2f3-4397-9ccb-d23f5724ebe1'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:06 user nova-compute[82009]: INFO os_vif [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42')
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No VIF found with MAC fa:16:3e:80:b4:71, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:15:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updated VIF entry in instance network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f42e3c4c-880c-4c5f-b089-598157d999ee req-f00195bd-6730-4665-bfc8-3cfcc4ac6d02 service nova] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:08 user nova-compute[82009]: WARNING nova.compute.manager [req-a8f7b365-fecf-4353-8602-7bdf27bcd3e1 req-49d468bb-02e4-47fb-8a23-76165cfd9986 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state building and task_state spawning.
Apr 11 18:15:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236910.310805, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] VM Resumed (Lifecycle Event)
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance spawned successfully.
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236910.3111615, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] VM Started (Lifecycle Event)
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Took 6.14 seconds to spawn the instance on the hypervisor.
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:10 user nova-compute[82009]: WARNING nova.compute.manager [req-08d56e9a-ad48-4f87-8617-48ae31b00916 req-921fee0b-cc11-4e71-981f-44d11b56c025 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state building and task_state spawning.
Apr 11 18:15:10 user nova-compute[82009]: INFO nova.compute.manager [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Took 7.15 seconds to build instance.
Apr 11 18:15:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8d58b9ca-776a-4f96-ade0-bc668ab09539 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.263s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:15:14 user nova-compute[82009]: INFO nova.compute.claims [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Claim successful on node user
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:15:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.policy [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:15:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Creating image(s)
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "/opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "/opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "/opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk 1073741824" returned: 0 in 0.058s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Cannot resize image /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG nova.objects.instance [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'migration_context' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Ensure instance console log exists: /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Successfully created port: ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Successfully updated port: ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquired lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-changed-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Refreshing instance network info cache due to event network-changed-ca931e62-5efe-439f-831c-1792c67eae7f. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Acquiring lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Releasing lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Instance network_info: |[{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Acquired lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Refreshing network info cache for port ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Start _get_guest_xml network_info=[{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:15:17 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:17 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1875082957',display_name='tempest-TestStampPattern-server-1875082957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1875082957',id=19,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA==',key_name='tempest-TestStampPattern-1363613236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86e02898b1bc4378822244d9522ff042',ramdisk_id='',reservation_id='r-w52s19na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1680133886',owner_user_name='tempest-TestStampPattern-1680133886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:15:15Z,user_data=None,user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',uuid=91bf5195-b2bc-48ca-9632-5ae616090fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converting VIF {"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.objects.instance [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'pci_devices' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:15:17 user nova-compute[82009]:   <uuid>91bf5195-b2bc-48ca-9632-5ae616090fd2</uuid>
Apr 11 18:15:17 user nova-compute[82009]:   <name>instance-00000013</name>
Apr 11 18:15:17 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:15:17 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:15:17 user nova-compute[82009]:   <metadata>
Apr 11 18:15:17 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:15:17 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:15:17 user nova-compute[82009]:       <nova:name>tempest-TestStampPattern-server-1875082957</nova:name>
Apr 11 18:15:17 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:15:17</nova:creationTime>
Apr 11 18:15:17 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:15:17 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:15:17 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:15:17 user nova-compute[82009]:       <nova:owner>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:user uuid="c44e6b75d86f4ff0b6f93123ce15ccc0">tempest-TestStampPattern-1680133886-project-member</nova:user>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:project uuid="86e02898b1bc4378822244d9522ff042">tempest-TestStampPattern-1680133886</nova:project>
Apr 11 18:15:17 user nova-compute[82009]:       </nova:owner>
Apr 11 18:15:17 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:15:17 user nova-compute[82009]:       <nova:ports>
Apr 11 18:15:17 user nova-compute[82009]:         <nova:port uuid="ca931e62-5efe-439f-831c-1792c67eae7f">
Apr 11 18:15:17 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 18:15:17 user nova-compute[82009]:         </nova:port>
Apr 11 18:15:17 user nova-compute[82009]:       </nova:ports>
Apr 11 18:15:17 user nova-compute[82009]:     </nova:instance>
Apr 11 18:15:17 user nova-compute[82009]:   </metadata>
Apr 11 18:15:17 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:15:17 user nova-compute[82009]:     <system>
Apr 11 18:15:17 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:15:17 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:15:17 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:15:17 user nova-compute[82009]:       <entry name="serial">91bf5195-b2bc-48ca-9632-5ae616090fd2</entry>
Apr 11 18:15:17 user nova-compute[82009]:       <entry name="uuid">91bf5195-b2bc-48ca-9632-5ae616090fd2</entry>
Apr 11 18:15:17 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:15:17 user nova-compute[82009]:     </system>
Apr 11 18:15:17 user nova-compute[82009]:   </sysinfo>
Apr 11 18:15:17 user nova-compute[82009]:   <os>
Apr 11 18:15:17 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:15:17 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:15:17 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:15:17 user nova-compute[82009]:   </os>
Apr 11 18:15:17 user nova-compute[82009]:   <features>
Apr 11 18:15:17 user nova-compute[82009]:     <acpi/>
Apr 11 18:15:17 user nova-compute[82009]:     <apic/>
Apr 11 18:15:17 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:15:17 user nova-compute[82009]:   </features>
Apr 11 18:15:17 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:15:17 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:15:17 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:15:17 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:15:17 user nova-compute[82009]:   </clock>
Apr 11 18:15:17 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:15:17 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:15:17 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:15:17 user nova-compute[82009]:   </cpu>
Apr 11 18:15:17 user nova-compute[82009]:   <devices>
Apr 11 18:15:17 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:15:17 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:15:17 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk"/>
Apr 11 18:15:17 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:15:17 user nova-compute[82009]:     </disk>
Apr 11 18:15:17 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:15:17 user nova-compute[82009]:       <mac address="fa:16:3e:23:ef:f2"/>
Apr 11 18:15:17 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:15:17 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:15:17 user nova-compute[82009]:       <target dev="tapca931e62-5e"/>
Apr 11 18:15:17 user nova-compute[82009]:     </interface>
Apr 11 18:15:17 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:15:17 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/console.log" append="off"/>
Apr 11 18:15:17 user nova-compute[82009]:     </serial>
Apr 11 18:15:17 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:15:17 user nova-compute[82009]:     <video>
Apr 11 18:15:17 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:15:17 user nova-compute[82009]:     </video>
Apr 11 18:15:17 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:15:17 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:15:17 user nova-compute[82009]:     </rng>
Apr 11 18:15:17 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:15:17 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:15:17 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:15:17 user nova-compute[82009]:     </memballoon>
Apr 11 18:15:17 user nova-compute[82009]:   </devices>
Apr 11 18:15:17 user nova-compute[82009]: </domain>
Apr 11 18:15:17 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1875082957',display_name='tempest-TestStampPattern-server-1875082957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1875082957',id=19,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA==',key_name='tempest-TestStampPattern-1363613236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86e02898b1bc4378822244d9522ff042',ramdisk_id='',reservation_id='r-w52s19na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1680133886',owner_user_name='tempest-TestStampPattern-1680133886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:15:15Z,user_data=None,user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',uuid=91bf5195-b2bc-48ca-9632-5ae616090fd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converting VIF {"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG os_vif [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca931e62-5e, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca931e62-5e, col_values=(('external_ids', {'iface-id': 'ca931e62-5efe-439f-831c-1792c67eae7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ef:f2', 'vm-uuid': '91bf5195-b2bc-48ca-9632-5ae616090fd2'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: INFO os_vif [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e')
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No VIF found with MAC fa:16:3e:23:ef:f2, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-changed-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing instance network info cache due to event network-changed-d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing network info cache for port d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.004s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:17 user nova-compute[82009]: INFO nova.compute.manager [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Shelve offloading
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updated VIF entry in instance network info cache for port ca931e62-5efe-439f-831c-1792c67eae7f. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-214a91a0-9704-4f92-b440-e684dd6ece9a req-6236272e-dc7f-47ec-b112-efe060ee4754 service nova] Releasing lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:18 user nova-compute[82009]: DEBUG nova.network.neutron [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updated VIF entry in instance network info cache for port d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:18 user nova-compute[82009]: DEBUG nova.network.neutron [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-94b4bc34-d2e4-46b9-963e-f68166117ce6 req-6682cec9-fb81-4bc1-820d-dc942df531a2 service nova] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:19 user nova-compute[82009]: WARNING nova.compute.manager [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state shelving.
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:19 user nova-compute[82009]: WARNING nova.compute.manager [req-5db8c078-b985-40ea-a998-68dd96a846e7 req-b0c9bf94-187e-41e9-be89-75e4c4e891b7 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state shelving.
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance destroyed successfully.
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance destroyed successfully.
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'resources' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1554900069',display_name='tempest-TestShelveInstance-server-1554900069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1554900069',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJoEwkISzTf/Xl7bcqN5WFtK8IzBxrVabbCuw9Mu4MRtB0G1QNlNr8PwZepxAvxrQAcbqFk6TTH2cZjSmdlEbyBSzPwALnwMfNcWaTDuhhOtxF38FYCkmUerlI+JQ1TEg==',key_name='tempest-TestShelveInstance-1371472427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6090bfb65d0c4afeb5ac38c45083799d',ramdisk_id='',reservation_id='r-trhuh3i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-839951281',owner_user_name='tempest-TestShelveInstance-839951281-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:13:35Z,user_data=None,user_id='43dc7c5c888247029ff6adedbdb2e938',uuid=2fef8f1e-9300-4bd6-8958-4386541a9c0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converting VIF {"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_vif [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd870c097-5a, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:15:20 user nova-compute[82009]: INFO os_vif [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a')
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:15:20 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a55fb48-3c6b-40eb-bd6f-83d4ab7d0c82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:15:20 user nova-compute[82009]: No targets found.
Apr 11 18:15:20 user nova-compute[82009]: iSNS:
Apr 11 18:15:20 user nova-compute[82009]: No targets found.
Apr 11 18:15:20 user nova-compute[82009]: STATIC:
Apr 11 18:15:20 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:15:20 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:20 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:20 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:15:20 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:20 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:20 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:15:20 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:20 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:20 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e
Apr 11 18:15:20 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:20 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:20 user nova-compute[82009]: FIRMWARE:
Apr 11 18:15:20 user nova-compute[82009]: No targets found.
Apr 11 18:15:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:15:20 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:15:20 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-changed-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing instance network info cache due to event network-changed-d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing network info cache for port d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851f0d6-9d01-4167-9882-84c7a9c00444]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74090054-b0df-4588-b9ce-c0a8b4bec856]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:15:20 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:15:20 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:20 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:15:20 user nova-compute[82009]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:15:20 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:20 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e022cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af19708-102d-4920-8afd-8e8b868db368]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[272482a0-71d5-4e3b-aaf7-5481e3d3f69d]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e9f6f-ac84-4d13-a30c-491bbee304e3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d64bc-40d9-49a9-8ce6-b3ed500cb991]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:15:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f445254-7816-462b-9b48-dffd03c0836e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:21 user nova-compute[82009]: WARNING nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state shelving.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:21 user nova-compute[82009]: WARNING nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state shelving.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:21 user nova-compute[82009]: WARNING nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state shelving.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:21 user nova-compute[82009]: WARNING nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state shelving.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] No waiting events found dispatching network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:21 user nova-compute[82009]: WARNING nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received unexpected event network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f for instance with vm_state building and task_state spawning.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] No waiting events found dispatching network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:21 user nova-compute[82009]: WARNING nova.compute.manager [req-00d73879-61ec-48e4-8aa3-1e2ca934b0f3 req-e5b1d1c9-8c4b-448e-8b55-53a714285040 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received unexpected event network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f for instance with vm_state building and task_state spawning.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d7c331-a12a-4a7c-8a3c-1f19dc5df78e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]
Apr 11 18:15:21 user nova-compute[82009]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.
Apr 11 18:15:21 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff76a61-b926-44cd-b3cb-b37d3521f69b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] <== disconnect_volume: return (405ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Deleting instance files /opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c_del
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Deletion of /opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c_del complete
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updated VIF entry in instance network info cache for port d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": null, "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd870c097-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ab730fa6-2109-4548-84ce-ce9638dc6a5b req-20bcd475-915c-4377-a6f6-33bcc19a5a8b service nova] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236921.5625849, 91bf5195-b2bc-48ca-9632-5ae616090fd2 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] VM Resumed (Lifecycle Event)
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Instance spawned successfully.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236921.565547, 91bf5195-b2bc-48ca-9632-5ae616090fd2 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] VM Started (Lifecycle Event)
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Took 6.84 seconds to spawn the instance on the hypervisor.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:21 user nova-compute[82009]: INFO nova.compute.manager [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Took 7.64 seconds to build instance.
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-18f5cf03-0505-4ecf-9fc6-82ffb0136644 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.778s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-changed-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing instance network info cache due to event network-changed-9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing network info cache for port 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:22 user nova-compute[82009]: INFO nova.compute.manager [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Detaching volume 66e98e6d-f7ea-48df-a28b-c9148c90317e
Apr 11 18:15:22 user nova-compute[82009]: INFO nova.virt.block_device [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Attempting to driver detach volume 66e98e6d-f7ea-48df-a28b-c9148c90317e from mountpoint /dev/vdb
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Attempting to detach device vdb from instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:15:22 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:15:22 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:15:22 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:15:22 user nova-compute[82009]:   <serial>66e98e6d-f7ea-48df-a28b-c9148c90317e</serial>
Apr 11 18:15:22 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:15:22 user nova-compute[82009]: </disk>
Apr 11 18:15:22 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:15:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully detached device vdb from instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 from the persistent domain config.
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:15:22 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:15:22 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:15:22 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:15:22 user nova-compute[82009]:   <serial>66e98e6d-f7ea-48df-a28b-c9148c90317e</serial>
Apr 11 18:15:22 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:15:22 user nova-compute[82009]: </disk>
Apr 11 18:15:22 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:15:22 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Deleted allocations for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c
Apr 11 18:15:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'numa_topology' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updated VIF entry in instance network info cache for port 9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fbb16ea2-e501-4ae7-acf5-296d6bc4df4f req-32d88f18-0e32-44a2-b159-a6227024bfbb service nova] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236923.1502738, 2e78a3ea-f132-4da0-81f1-d6745390b0d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:15:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully detached device vdb from instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 from the live domain config.
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWVryuZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:15:23 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-changed-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing instance network info cache due to event network-changed-9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Acquiring lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Acquired lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Refreshing network info cache for port 9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e37dc-124e-4583-bddd-355424695c0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:15:23 user nova-compute[82009]: No targets found.
Apr 11 18:15:23 user nova-compute[82009]: iSNS:
Apr 11 18:15:23 user nova-compute[82009]: No targets found.
Apr 11 18:15:23 user nova-compute[82009]: STATIC:
Apr 11 18:15:23 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:15:23 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:23 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:23 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:15:23 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:23 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:23 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e
Apr 11 18:15:23 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:23 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:23 user nova-compute[82009]: FIRMWARE:
Apr 11 18:15:23 user nova-compute[82009]: No targets found.
Apr 11 18:15:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:15:23 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:15:23 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6959b3-7226-4e5a-9b93-c592ef91c12c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fefd4c-b3d5-4b2a-b59a-5ed3a7835666]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:15:23 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:23 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e (non-flash)
Apr 11 18:15:23 user nova-compute[82009]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:23 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8289c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3e3742a8-5ba7-4dd3-91ea-55e666f1336d tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.496s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e99190-cf52-4d1c-b61e-6b19430457eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dad0f1-32a7-4086-bf24-e4347e7bfeba]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebb7108-3e9c-4641-9d65-eae09180d250]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[802857b8-80ee-4765-bc6b-af08d33cd024]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c4cceb-3b20-4d6c-9da4-f8ff2f41daa1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e15ba-9edc-4494-bcf1-1939a705996b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260]
Apr 11 18:15:23 user nova-compute[82009]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e, portal: 172.16.0.220,3260] successful.
Apr 11 18:15:23 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e98e6d-f7ea-48df-a28b-c9148c90317e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff2ae2f-f250-414a-9b3a-7494be58c61f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== disconnect_volume: return (387ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updated VIF entry in instance network info cache for port 9f1432e1-1448-4815-a940-c004344002a0. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [{"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d0a2d405-2463-45d9-8806-38836220de06 req-66b4a258-c197-45cb-a894-03bacbbabb53 service nova] Releasing lock "refresh_cache-2e78a3ea-f132-4da0-81f1-d6745390b0d6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:24 user nova-compute[82009]: DEBUG nova.objects.instance [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'flavor' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-681b9507-54e0-47dd-951c-309fe625df99 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.189s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:34 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236919.1752546, 2fef8f1e-9300-4bd6-8958-4386541a9c0c => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:34 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] VM Stopped (Lifecycle Event)
Apr 11 18:15:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7096cb8b-b743-4cb3-8d19-baf94242f06a None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:41 user nova-compute[82009]: INFO nova.compute.manager [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Terminating instance
Apr 11 18:15:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-unplugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-unplugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-77392f44-fe5a-452f-897c-3b785d7c347a req-d5a2d606-b714-4c14-8a3f-4172bc85b587 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-unplugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Instance destroyed successfully.
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.objects.instance [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lazy-loading 'resources' on Instance uuid 34ce2adc-e171-42fd-8c28-6359d56f612e {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1899339481',display_name='tempest-VolumesActionsTest-instance-1899339481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1899339481',id=14,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf13b304615f48ab88c64755c2795c99',ramdisk_id='',reservation_id='r-h1g3pb10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1596862779',owner_user_name='tempest-VolumesActionsTest-1596862779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:14:00Z,user_data=None,user_id='086769a77da24d95a54c35f917240664',uuid=34ce2adc-e171-42fd-8c28-6359d56f612e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converting VIF {"id": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "address": "fa:16:3e:50:22:8a", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3cff827-10", "ovs_interfaceid": "e3cff827-1068-4b1c-b1d9-e1aba348f9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG os_vif [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3cff827-10, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:15:42 user nova-compute[82009]: INFO os_vif [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=e3cff827-1068-4b1c-b1d9-e1aba348f9d9,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3cff827-10')
Apr 11 18:15:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Deleting instance files /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e_del
Apr 11 18:15:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Deletion of /opt/stack/data/nova/instances/34ce2adc-e171-42fd-8c28-6359d56f612e_del complete
Apr 11 18:15:42 user nova-compute[82009]: INFO nova.compute.manager [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Took 0.77 seconds to destroy the instance on the hypervisor.
Apr 11 18:15:42 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:15:42 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:15:43 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:43 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Took 0.95 seconds to deallocate network for instance.
Apr 11 18:15:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-6c30db2c-a7b2-444e-9c33-c4b4951b4789 req-f4a18efb-86c3-4987-86b3-114ce3fcd4ad service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-deleted-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Deleted allocations for instance 34ce2adc-e171-42fd-8c28-6359d56f612e
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc8191c-e832-4918-a05c-0fb014c33a87 tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:44 user nova-compute[82009]: WARNING nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state deleted and task_state None.
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:44 user nova-compute[82009]: WARNING nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state deleted and task_state None.
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:44 user nova-compute[82009]: WARNING nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state deleted and task_state None.
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-unplugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-unplugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:44 user nova-compute[82009]: WARNING nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-unplugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state deleted and task_state None.
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Acquiring lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] Lock "34ce2adc-e171-42fd-8c28-6359d56f612e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] No waiting events found dispatching network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:15:44 user nova-compute[82009]: WARNING nova.compute.manager [req-4ecacb91-d061-4f2f-a0cc-8e7f479c0975 req-be1d6aae-3156-4cc2-baf6-24a03dc18216 service nova] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Received unexpected event network-vif-plugged-e3cff827-1068-4b1c-b1d9-e1aba348f9d9 for instance with vm_state deleted and task_state None.
Apr 11 18:15:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:15:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:15:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-changed-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:15:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Refreshing instance network info cache due to event network-changed-8110c1e3-0ed5-46e0-8f26-6c6d00460693. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:15:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Acquiring lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Acquired lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Refreshing network info cache for port 8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:15:50 user nova-compute[82009]: DEBUG nova.network.neutron [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updated VIF entry in instance network info cache for port 8110c1e3-0ed5-46e0-8f26-6c6d00460693. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:15:50 user nova-compute[82009]: DEBUG nova.network.neutron [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating instance_info_cache with network_info: [{"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:15:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5be0176-d938-4868-a3dc-61ddbe23b771 req-66a1666a-c8d2-4ddc-a430-6d362ccfa09d service nova] Releasing lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG nova.objects.instance [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'flavor' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:51 user nova-compute[82009]: INFO nova.compute.manager [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Attaching volume 7df58904-80cf-4563-a8a4-8e753e6eed96 to /dev/vdb
Apr 11 18:15:51 user nova-compute[82009]: DEBUG os_brick.utils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[064014f9-6fdc-4392-a765-68bd441aa856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb27ca3-a121-4211-822d-bd3962273238]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6325bbe-0f75-4540-8657-9cfec79a5776]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e7c76-429b-4fa9-80f5-b21acab23298]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:15:51 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:15:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83a254-56f6-4a2f-bb33-0e208dce62a6]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG os_brick.utils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:15:51 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating existing volume attachment record: bd8a83f4-d13b-43e2-a308-17b040206b48 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:15:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:52 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:15:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:15:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:15:54 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:54 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:15:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:54 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLGExPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:15:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:15:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:15:55 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011fc80-085b-4523-be23-98a2a128e20b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:15:55 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ecf93d-4cac-4f10-94b5-f605a3b315ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96] added
Apr 11 18:15:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d91aa9-0574-40f6-b5f0-ad3c3b90b306]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d44be9-4a6e-4479-9083-75dcbba38ec5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJLGExPq {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJLGExPq" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7240cbe-0990-44aa-b6c8-7c0c6e013d0c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OJLGExPq'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f676581-2bed-4dec-9b03-19d427d2a072]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7857132b-825e-40f2-843b-ef44e5890389]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:55 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:55 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc9eda5-8211-4978-9fc7-d772918612ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260]
Apr 11 18:15:55 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260] successful.
Apr 11 18:15:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e92295-aaa1-4ec5-93af-5d682a9a2ddc]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5de7c11-b6de-49a7-a3bf-4ea7b3ec840f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:56 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:56 user nova-compute[82009]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 (non-flash)
Apr 11 18:15:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:56 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:56 user nova-compute[82009]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 (non-flash)
Apr 11 18:15:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3029995f-5bbb-4956-9e79-b155ba336e36]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLGExPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26465373166346564', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465373166346564', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'flavor' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:15:57 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:15:57 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:15:57 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:15:57 user nova-compute[82009]:   <serial>7df58904-80cf-4563-a8a4-8e753e6eed96</serial>
Apr 11 18:15:57 user nova-compute[82009]: </disk>
Apr 11 18:15:57 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No VIF found with MAC fa:16:3e:f8:c4:74, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236942.6228313, 34ce2adc-e171-42fd-8c28-6359d56f612e => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:15:57 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] VM Stopped (Lifecycle Event)
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4e110f3b-5140-4cdc-a421-02d565328f4f None None] [instance: 34ce2adc-e171-42fd-8c28-6359d56f612e] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-12f28f6b-f71a-408b-a0f3-4ec9e67e2425 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.347s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:58 user nova-compute[82009]: INFO nova.compute.manager [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Detaching volume 7df58904-80cf-4563-a8a4-8e753e6eed96
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: INFO nova.virt.block_device [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Attempting to driver detach volume 7df58904-80cf-4563-a8a4-8e753e6eed96 from mountpoint /dev/vdb
Apr 11 18:15:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Attempting to detach device vdb from instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:15:58 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:15:58 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:15:58 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:15:58 user nova-compute[82009]:   <serial>7df58904-80cf-4563-a8a4-8e753e6eed96</serial>
Apr 11 18:15:58 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:15:58 user nova-compute[82009]: </disk>
Apr 11 18:15:58 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:15:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Successfully detached device vdb from instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 from the persistent domain config.
Apr 11 18:15:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:15:58 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:15:58 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:15:58 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:15:58 user nova-compute[82009]:   <serial>7df58904-80cf-4563-a8a4-8e753e6eed96</serial>
Apr 11 18:15:58 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:15:58 user nova-compute[82009]: </disk>
Apr 11 18:15:58 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236958.9535239, db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:15:59 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Successfully detached device vdb from instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 from the live domain config.
Apr 11 18:15:59 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:59 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=26.39482879638672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLGExPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:15:59 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[78104233-223f-4c91-9618-6252d7f10b34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:15:59 user nova-compute[82009]: No targets found.
Apr 11 18:15:59 user nova-compute[82009]: iSNS:
Apr 11 18:15:59 user nova-compute[82009]: No targets found.
Apr 11 18:15:59 user nova-compute[82009]: STATIC:
Apr 11 18:15:59 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96
Apr 11 18:15:59 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:59 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:59 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:15:59 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:59 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:59 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:15:59 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:15:59 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:15:59 user nova-compute[82009]: FIRMWARE:
Apr 11 18:15:59 user nova-compute[82009]: No targets found.
Apr 11 18:15:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:15:59 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:15:59 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6cb15-aff9-4b0f-8f4d-0b2629b1f74d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50454bb-9800-4a0f-a593-f5a93b55e9f7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:59 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:59 user nova-compute[82009]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 (non-flash)
Apr 11 18:15:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:15:59 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:15:59 user nova-compute[82009]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 (non-flash)
Apr 11 18:15:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6ba5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5207bf80-68c2-4051-bfa4-e46c30b8861a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[760b64f1-1ad9-48ee-97cf-a443cab386d7]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: INFO nova.compute.manager [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Unrescuing
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbd32a7-3993-42b6-8049-8505575d8a0d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b072503-b57c-4c25-a07a-e253cddca973]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e8a4a-72f5-49b6-847a-4b246adf038b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 311f2066-14ca-4e4a-b475-7b4314dd45fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc0f23e-b697-4fff-ae81-53291ab906ab]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260]
Apr 11 18:15:59 user nova-compute[82009]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96, portal: 172.16.0.220,3260] successful.
Apr 11 18:15:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7df58904-80cf-4563-a8a4-8e753e6eed96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e7c528-5f8a-44ed-9f10-3a555472c43b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] <== disconnect_volume: return (351ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:15:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'flavor' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.874s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'flavor' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-16a7d9da-1a8a-432f-a13d-7bbde3f5af54 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.302s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:00 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance destroyed successfully.
Apr 11 18:16:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:01 user nova-compute[82009]: WARNING nova.compute.manager [req-dc1e8378-f817-428f-91cd-a1d58508e234 req-4c1fa068-5437-4211-be9c-4985fb1c9b72 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:16:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing instance network info cache due to event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updated VIF entry in instance network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:03 user nova-compute[82009]: WARNING nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing instance network info cache due to event network-changed-8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquiring lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquired lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Refreshing network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updated VIF entry in instance network info cache for port 8be7e2fa-afa5-4bb3-a32b-95a701a17a65. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [{"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Releasing lock "refresh_cache-1f3000ca-5a67-4814-bf9d-94415c8f3d9d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:04 user nova-compute[82009]: WARNING nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:04 user nova-compute[82009]: WARNING nova.compute.manager [req-c90179f7-946e-4b44-a624-6faec2fe3309 req-ce879831-d547-4170-bdc2-8d3ac78837de service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 1f3000ca-5a67-4814-bf9d-94415c8f3d9d due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236964.390131, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:04 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Resumed (Lifecycle Event)
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9af27f5b-60d4-4206-877b-6962c7b9b694 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:04 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681236964.3913634, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:04 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Started (Lifecycle Event)
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:13 user nova-compute[82009]: INFO nova.compute.manager [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Terminating instance
Apr 11 18:16:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-unplugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-unplugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b10711d-d953-41e4-88ac-34605d05a74c req-fe5c2cf5-4646-4f32-819d-1dcf3878e248 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-unplugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:16:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Instance destroyed successfully.
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'resources' on Instance uuid 2e78a3ea-f132-4da0-81f1-d6745390b0d6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-621502840',display_name='tempest-TestMinimumBasicScenario-server-621502840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-621502840',id=12,image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmd/yE3bBAxOdBKdt1Ayzg7G97iK2JxGkSCrMcdQix6650rqBKsqpwTQWmSa+MC+5/dMX/ZLO8vwHcOD+TlcyotQK3dAchCvGVgAFE3m0sL0ctQH8jMycmC6acbWwLIGw==',key_name='tempest-TestMinimumBasicScenario-1430519022',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-tfsvslnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='88fbddbd-d9dc-4e1a-a8c3-9c0c53a412de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:13:37Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=2e78a3ea-f132-4da0-81f1-d6745390b0d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "9f1432e1-1448-4815-a940-c004344002a0", "address": "fa:16:3e:43:43:b7", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1432e1-14", "ovs_interfaceid": "9f1432e1-1448-4815-a940-c004344002a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG os_vif [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f1432e1-14, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:14 user nova-compute[82009]: INFO os_vif [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=9f1432e1-1448-4815-a940-c004344002a0,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1432e1-14')
Apr 11 18:16:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Deleting instance files /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6_del
Apr 11 18:16:14 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Deletion of /opt/stack/data/nova/instances/2e78a3ea-f132-4da0-81f1-d6745390b0d6_del complete
Apr 11 18:16:14 user nova-compute[82009]: INFO nova.compute.manager [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 18:16:14 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:16:14 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:16:15 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:15 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Took 0.49 seconds to deallocate network for instance.
Apr 11 18:16:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-564c5109-1166-41f7-b3eb-4f06780cca14 req-36fd5f69-cb00-439a-96f0-bfbddb1b6e77 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-deleted-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:15 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:16:15 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:16:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:15 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Deleted allocations for instance 2e78a3ea-f132-4da0-81f1-d6745390b0d6
Apr 11 18:16:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b6e8c903-23e9-483b-b1fc-2ee384be5aa9 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Acquiring lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] Lock "2e78a3ea-f132-4da0-81f1-d6745390b0d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] No waiting events found dispatching network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:16 user nova-compute[82009]: WARNING nova.compute.manager [req-3523f03e-b197-45bd-94c0-fe37bbe74b97 req-a9226c16-5bb6-4258-9c1c-1b33eb470aa5 service nova] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Received unexpected event network-vif-plugged-9f1432e1-1448-4815-a940-c004344002a0 for instance with vm_state deleted and task_state None.
Apr 11 18:16:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:17 user nova-compute[82009]: INFO nova.compute.manager [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Detaching volume 7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:16:17 user nova-compute[82009]: INFO nova.virt.block_device [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Attempting to driver detach volume 7d656453-9ad5-4870-b6af-cf2022addc76 from mountpoint /dev/vdb
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Attempting to detach device vdb from instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:16:17 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:16:17 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:16:17 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:16:17 user nova-compute[82009]:   <serial>7d656453-9ad5-4870-b6af-cf2022addc76</serial>
Apr 11 18:16:17 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:16:17 user nova-compute[82009]: </disk>
Apr 11 18:16:17 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:16:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Successfully detached device vdb from instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d from the persistent domain config.
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:16:17 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:16:17 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:16:17 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:16:17 user nova-compute[82009]:   <serial>7d656453-9ad5-4870-b6af-cf2022addc76</serial>
Apr 11 18:16:17 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:16:17 user nova-compute[82009]: </disk>
Apr 11 18:16:17 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681236977.9457374, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:16:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Successfully detached device vdb from instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d from the live domain config.
Apr 11 18:16:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmXoPbBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:16:17 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:16:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec154f1-0752-49f2-bc31-361753ec861d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:16:17 user nova-compute[82009]: No targets found.
Apr 11 18:16:17 user nova-compute[82009]: iSNS:
Apr 11 18:16:17 user nova-compute[82009]: No targets found.
Apr 11 18:16:17 user nova-compute[82009]: STATIC:
Apr 11 18:16:17 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:16:17 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:16:17 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:16:17 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76
Apr 11 18:16:17 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:16:17 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:16:17 user nova-compute[82009]: FIRMWARE:
Apr 11 18:16:17 user nova-compute[82009]: No targets found.
Apr 11 18:16:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:16:17 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:16:17 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[280b9f96-b43f-477d-aea4-2eb4ace47acc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[037dfeaf-9c71-46c4-9ca5-32ecd44c3bba]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:16:18 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:16:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 (non-flash)
Apr 11 18:16:18 user nova-compute[82009]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:16:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6cb1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b36e8-4b32-48cb-8a1a-4d7cf77cd562]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f54f8-adde-411d-8295-b4503f749e6e]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[807dfee7-5405-4c47-a915-2c1f15a905ab]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf8592-4851-44b7-87d2-9f7e65ae2ef7]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7e7065-1627-4e0a-968f-3b483e13bbe7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53712412-963f-4d4e-bec6-4377b4b48385]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260]
Apr 11 18:16:18 user nova-compute[82009]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76, portal: 172.16.0.220,3260] successful.
Apr 11 18:16:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d656453-9ad5-4870-b6af-cf2022addc76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c841472e-02c6-4b19-b20c-567e4731e757]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] <== disconnect_volume: return (273ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:16:18 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'flavor' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e1c06c1e-eb69-4665-bf52-8ee248500480 tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:29 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236974.6882157, 2e78a3ea-f132-4da0-81f1-d6745390b0d6 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:29 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] VM Stopped (Lifecycle Event)
Apr 11 18:16:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2bc18ea-a28e-4898-a994-29ff39e61d52 None None] [instance: 2e78a3ea-f132-4da0-81f1-d6745390b0d6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:31 user nova-compute[82009]: INFO nova.compute.manager [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Terminating instance
Apr 11 18:16:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-unplugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-unplugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-7080cff3-098d-41ab-8cd3-b1716e25ad64 req-f8ec525e-6462-4ab9-a0c2-0d4313ad7201 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-unplugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Instance destroyed successfully.
Apr 11 18:16:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lazy-loading 'resources' on Instance uuid 311f2066-14ca-4e4a-b475-7b4314dd45fe {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-951270215',display_name='tempest-VolumesNegativeTest-instance-951270215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-951270215',id=16,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6a391811fbc45a4a36f4fa1a63cee7f',ramdisk_id='',reservation_id='r-tc7zkxtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-197324575',owner_user_name='tempest-VolumesNegativeTest-197324575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:14:48Z,user_data=None,user_id='0c4a8dda134b46e4bd1ebf41c01cf218',uuid=311f2066-14ca-4e4a-b475-7b4314dd45fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Converting VIF {"id": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "address": "fa:16:3e:47:d0:2b", "network": {"id": "ce5b90e4-502f-4eca-a4ca-eaff37b75efe", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fe2a05d643624bb4b15cf9e4ce303e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b50ddea-df", "ovs_interfaceid": "9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG os_vif [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b50ddea-df, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:16:32 user nova-compute[82009]: INFO os_vif [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d0:2b,bridge_name='br-int',has_traffic_filtering=True,id=9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6,network=Network(ce5b90e4-502f-4eca-a4ca-eaff37b75efe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b50ddea-df')
Apr 11 18:16:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Deleting instance files /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe_del
Apr 11 18:16:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Deletion of /opt/stack/data/nova/instances/311f2066-14ca-4e4a-b475-7b4314dd45fe_del complete
Apr 11 18:16:32 user nova-compute[82009]: INFO nova.compute.manager [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 11 18:16:32 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:32 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_power_states {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:33 user nova-compute[82009]: WARNING nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 311f2066-14ca-4e4a-b475-7b4314dd45fe {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "216db027-e3a6-4027-9aa7-07031623c674" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.005s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "216db027-e3a6-4027-9aa7-07031623c674" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:33 user nova-compute[82009]: WARNING nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received unexpected event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with vm_state active and task_state deleting.
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:33 user nova-compute[82009]: WARNING nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received unexpected event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with vm_state active and task_state deleting.
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:33 user nova-compute[82009]: WARNING nova.compute.manager [req-95cc58e1-4065-40e0-ab6f-89500488c9f4 req-5e9925bf-e152-4659-a9db-9e23a16a984f service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received unexpected event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with vm_state active and task_state deleting.
Apr 11 18:16:33 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:33 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Took 1.62 seconds to deallocate network for instance.
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:34 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Deleted allocations for instance 311f2066-14ca-4e4a-b475-7b4314dd45fe
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-abc46cd3-99e4-490f-99a2-ca94abc61acb tempest-VolumesNegativeTest-197324575 tempest-VolumesNegativeTest-197324575-project-member] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.129s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.207s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:34 user nova-compute[82009]: INFO nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:16:34 user nova-compute[82009]: INFO nova.compute.claims [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Claim successful on node user
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:16:34 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.policy [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '086769a77da24d95a54c35f917240664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf13b304615f48ab88c64755c2795c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:16:34 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Creating image(s)
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "/opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "/opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk 1073741824" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Cannot resize image /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lazy-loading 'migration_context' on Instance uuid 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Successfully created port: bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Ensure instance console log exists: /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Acquiring lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] Lock "311f2066-14ca-4e4a-b475-7b4314dd45fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] No waiting events found dispatching network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:35 user nova-compute[82009]: WARNING nova.compute.manager [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received unexpected event network-vif-plugged-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 for instance with vm_state deleted and task_state None.
Apr 11 18:16:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-ac9af90b-994f-4792-a4d0-dd7223a1a933 req-a144b97b-fee2-4a54-9909-9d2cba12a422 service nova] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Received event network-vif-deleted-9b50ddea-dfeb-49db-a6d0-9dcfbb77b3b6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Successfully updated port: bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "refresh_cache-9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquired lock "refresh_cache-9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Updating instance_info_cache with network_info: [{"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Releasing lock "refresh_cache-9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Instance network_info: |[{"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Start _get_guest_xml network_info=[{"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:16:36 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:16:36 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1416952030',display_name='tempest-VolumesActionsTest-instance-1416952030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1416952030',id=20,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf13b304615f48ab88c64755c2795c99',ramdisk_id='',reservation_id='r-n9783c0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1596862779',owner_user_name='tempest-VolumesActionsTest-1596862779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:16:35Z,user_data=None,user_id='086769a77da24d95a54c35f917240664',uuid=9b2e9f51-531f-4f4c-a1ce-75e2cfd337df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converting VIF {"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:16:36 user nova-compute[82009]:   <uuid>9b2e9f51-531f-4f4c-a1ce-75e2cfd337df</uuid>
Apr 11 18:16:36 user nova-compute[82009]:   <name>instance-00000014</name>
Apr 11 18:16:36 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:16:36 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:16:36 user nova-compute[82009]:   <metadata>
Apr 11 18:16:36 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:16:36 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:16:36 user nova-compute[82009]:       <nova:name>tempest-VolumesActionsTest-instance-1416952030</nova:name>
Apr 11 18:16:36 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:16:36</nova:creationTime>
Apr 11 18:16:36 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:16:36 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:16:36 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:16:36 user nova-compute[82009]:       <nova:owner>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:user uuid="086769a77da24d95a54c35f917240664">tempest-VolumesActionsTest-1596862779-project-member</nova:user>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:project uuid="bf13b304615f48ab88c64755c2795c99">tempest-VolumesActionsTest-1596862779</nova:project>
Apr 11 18:16:36 user nova-compute[82009]:       </nova:owner>
Apr 11 18:16:36 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:16:36 user nova-compute[82009]:       <nova:ports>
Apr 11 18:16:36 user nova-compute[82009]:         <nova:port uuid="bca9e38b-190a-4007-9778-58c7a8578078">
Apr 11 18:16:36 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:16:36 user nova-compute[82009]:         </nova:port>
Apr 11 18:16:36 user nova-compute[82009]:       </nova:ports>
Apr 11 18:16:36 user nova-compute[82009]:     </nova:instance>
Apr 11 18:16:36 user nova-compute[82009]:   </metadata>
Apr 11 18:16:36 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:16:36 user nova-compute[82009]:     <system>
Apr 11 18:16:36 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:16:36 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:16:36 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:16:36 user nova-compute[82009]:       <entry name="serial">9b2e9f51-531f-4f4c-a1ce-75e2cfd337df</entry>
Apr 11 18:16:36 user nova-compute[82009]:       <entry name="uuid">9b2e9f51-531f-4f4c-a1ce-75e2cfd337df</entry>
Apr 11 18:16:36 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:16:36 user nova-compute[82009]:     </system>
Apr 11 18:16:36 user nova-compute[82009]:   </sysinfo>
Apr 11 18:16:36 user nova-compute[82009]:   <os>
Apr 11 18:16:36 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:16:36 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:16:36 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:16:36 user nova-compute[82009]:   </os>
Apr 11 18:16:36 user nova-compute[82009]:   <features>
Apr 11 18:16:36 user nova-compute[82009]:     <acpi/>
Apr 11 18:16:36 user nova-compute[82009]:     <apic/>
Apr 11 18:16:36 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:16:36 user nova-compute[82009]:   </features>
Apr 11 18:16:36 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:16:36 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:16:36 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:16:36 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:16:36 user nova-compute[82009]:   </clock>
Apr 11 18:16:36 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:16:36 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:16:36 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:16:36 user nova-compute[82009]:   </cpu>
Apr 11 18:16:36 user nova-compute[82009]:   <devices>
Apr 11 18:16:36 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:16:36 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:16:36 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk"/>
Apr 11 18:16:36 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:16:36 user nova-compute[82009]:     </disk>
Apr 11 18:16:36 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:16:36 user nova-compute[82009]:       <mac address="fa:16:3e:88:78:55"/>
Apr 11 18:16:36 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:16:36 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:16:36 user nova-compute[82009]:       <target dev="tapbca9e38b-19"/>
Apr 11 18:16:36 user nova-compute[82009]:     </interface>
Apr 11 18:16:36 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:16:36 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/console.log" append="off"/>
Apr 11 18:16:36 user nova-compute[82009]:     </serial>
Apr 11 18:16:36 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:16:36 user nova-compute[82009]:     <video>
Apr 11 18:16:36 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:16:36 user nova-compute[82009]:     </video>
Apr 11 18:16:36 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:16:36 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:16:36 user nova-compute[82009]:     </rng>
Apr 11 18:16:36 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:16:36 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:16:36 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:16:36 user nova-compute[82009]:     </memballoon>
Apr 11 18:16:36 user nova-compute[82009]:   </devices>
Apr 11 18:16:36 user nova-compute[82009]: </domain>
Apr 11 18:16:36 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1416952030',display_name='tempest-VolumesActionsTest-instance-1416952030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1416952030',id=20,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf13b304615f48ab88c64755c2795c99',ramdisk_id='',reservation_id='r-n9783c0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1596862779',owner_user_name='tempest-VolumesActionsTest-1596862779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:16:35Z,user_data=None,user_id='086769a77da24d95a54c35f917240664',uuid=9b2e9f51-531f-4f4c-a1ce-75e2cfd337df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converting VIF {"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG os_vif [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbca9e38b-19, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbca9e38b-19, col_values=(('external_ids', {'iface-id': 'bca9e38b-190a-4007-9778-58c7a8578078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:78:55', 'vm-uuid': '9b2e9f51-531f-4f4c-a1ce-75e2cfd337df'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:36 user nova-compute[82009]: INFO os_vif [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19')
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:16:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] No VIF found with MAC fa:16:3e:88:78:55, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:16:37 user nova-compute[82009]: INFO nova.compute.manager [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Unrescuing
Apr 11 18:16:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-changed-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Refreshing instance network info cache due to event network-changed-bca9e38b-190a-4007-9778-58c7a8578078. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Acquiring lock "refresh_cache-9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Acquired lock "refresh_cache-9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:37 user nova-compute[82009]: DEBUG nova.network.neutron [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Refreshing network info cache for port bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] No waiting events found dispatching network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:38 user nova-compute[82009]: WARNING nova.compute.manager [req-494bc85f-4cc0-46e8-8a0a-b8eab60e53ea req-b3d27d14-29fe-47e1-967e-fc8670fe6544 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received unexpected event network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 for instance with vm_state building and task_state spawning.
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.network.neutron [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Updated VIF entry in instance network info cache for port bca9e38b-190a-4007-9778-58c7a8578078. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.network.neutron [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Updating instance_info_cache with network_info: [{"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5a96f5e1-29bf-4915-84e5-00fe3d1ac591 req-8ca4c3e6-3feb-4c63-a980-96eb3120e191 service nova] Releasing lock "refresh_cache-9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:38 user nova-compute[82009]: WARNING nova.compute.manager [req-de29e237-8e90-4e51-8557-57b977245a38 req-0757a355-87e4-4e3b-86bd-9fe31905961b service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance destroyed successfully.
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] No waiting events found dispatching network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-309bbe3b-91d6-424e-909d-124cbe8fcbe1 req-c634eb1f-0de5-4464-b737-d76cafe664dd service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received unexpected event network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 for instance with vm_state building and task_state spawning.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:40 user nova-compute[82009]: WARNING nova.compute.manager [req-49a01a9b-596d-4add-be42-65ffa2ab9fb8 req-f880f565-e287-4b84-8d8e-eddeee09b469 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237000.7923667, 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] VM Resumed (Lifecycle Event)
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Instance spawned successfully.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237000.7936308, 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] VM Started (Lifecycle Event)
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Took 6.03 seconds to spawn the instance on the hypervisor.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:16:40 user nova-compute[82009]: INFO nova.compute.manager [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Took 6.67 seconds to build instance.
Apr 11 18:16:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9fbb4623-a18d-44cf-8974-c914f94678da tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.759s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 253a1b67-06b0-4308-a2fc-78f36cda0ab8 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237002.3039165, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:42 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Resumed (Lifecycle Event)
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e69ff0e7-ab70-423b-a1ac-dcc50f7e628f tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:42 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237002.3066127, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:42 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Started (Lifecycle Event)
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681236992.0449128, 311f2066-14ca-4e4a-b475-7b4314dd45fe => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:47 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] VM Stopped (Lifecycle Event)
Apr 11 18:16:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-5f1f145d-2d74-4319-b2ef-63f3a116665a None None] [instance: 311f2066-14ca-4e4a-b475-7b4314dd45fe] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-changed-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Refreshing instance network info cache due to event network-changed-73d8e6ed-570b-444e-a062-22d66314138a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Acquiring lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Acquired lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.network.neutron [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Refreshing network info cache for port 73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.network.neutron [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updated VIF entry in instance network info cache for port 73d8e6ed-570b-444e-a062-22d66314138a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG nova.network.neutron [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-73901186-7069-4dbb-8da1-12509989e1bd req-d11ef14a-f19d-465c-8124-32ff1b4b068c service nova] Releasing lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:16:49 user nova-compute[82009]: INFO nova.compute.claims [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Claim successful on node user
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:50 user nova-compute[82009]: INFO nova.compute.manager [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Attaching volume 7fcd6aab-4190-481d-bea1-4aff73c18083 to /dev/vdb
Apr 11 18:16:50 user nova-compute[82009]: DEBUG os_brick.utils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc0ac9-148b-4593-abfd-370a6436698c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e7bd89-1472-464f-8fb6-4d62a379e7b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4926845d-5d3b-4563-9a3e-8e87ef6aa410]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa01c3-3a6e-41ab-a3e0-d86ce27d4510]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:16:50 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a0ed59-32ad-4c21-a981-688cfa8f5848]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG os_brick.utils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating existing volume attachment record: f014b013-12ba-4133-b4c4-5815ce55d39f {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:16:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:16:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Creating image(s)
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "/opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "/opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk 1073741824" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG nova.policy [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd20726e00e3743168e32eafe43318e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad8dd512b7424fbe996ecbd18d11471e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Cannot resize image /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'migration_context' on Instance uuid 2fdbfe12-0376-480d-a63d-7db4a2ac2243 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Ensure instance console log exists: /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Successfully created port: 8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Successfully updated port: 8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "refresh_cache-2fdbfe12-0376-480d-a63d-7db4a2ac2243" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquired lock "refresh_cache-2fdbfe12-0376-480d-a63d-7db4a2ac2243" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-changed-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Refreshing instance network info cache due to event network-changed-8fbca9dd-8f56-4336-be2e-7341f550e2a7. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Acquiring lock "refresh_cache-2fdbfe12-0376-480d-a63d-7db4a2ac2243" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:52 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Updating instance_info_cache with network_info: [{"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Releasing lock "refresh_cache-2fdbfe12-0376-480d-a63d-7db4a2ac2243" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Instance network_info: |[{"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Acquired lock "refresh_cache-2fdbfe12-0376-480d-a63d-7db4a2ac2243" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.neutron [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Refreshing network info cache for port 8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Start _get_guest_xml network_info=[{"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:16:53 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:16:53 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-909573337',display_name='tempest-VolumesAdminNegativeTest-server-909573337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-909573337',id=21,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad8dd512b7424fbe996ecbd18d11471e',ramdisk_id='',reservation_id='r-6x6vrm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-298923704',owner_user_name='tempest-VolumesAdminNegativeTest-298923704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:16:51Z,user_data=None,user_id='d20726e00e3743168e32eafe43318e20',uuid=2fdbfe12-0376-480d-a63d-7db4a2ac2243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converting VIF {"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fdbfe12-0376-480d-a63d-7db4a2ac2243 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:16:53 user nova-compute[82009]:   <uuid>2fdbfe12-0376-480d-a63d-7db4a2ac2243</uuid>
Apr 11 18:16:53 user nova-compute[82009]:   <name>instance-00000015</name>
Apr 11 18:16:53 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:16:53 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:16:53 user nova-compute[82009]:   <metadata>
Apr 11 18:16:53 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:16:53 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:16:53 user nova-compute[82009]:       <nova:name>tempest-VolumesAdminNegativeTest-server-909573337</nova:name>
Apr 11 18:16:53 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:16:53</nova:creationTime>
Apr 11 18:16:53 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:16:53 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:16:53 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:16:53 user nova-compute[82009]:       <nova:owner>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:user uuid="d20726e00e3743168e32eafe43318e20">tempest-VolumesAdminNegativeTest-298923704-project-member</nova:user>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:project uuid="ad8dd512b7424fbe996ecbd18d11471e">tempest-VolumesAdminNegativeTest-298923704</nova:project>
Apr 11 18:16:53 user nova-compute[82009]:       </nova:owner>
Apr 11 18:16:53 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:16:53 user nova-compute[82009]:       <nova:ports>
Apr 11 18:16:53 user nova-compute[82009]:         <nova:port uuid="8fbca9dd-8f56-4336-be2e-7341f550e2a7">
Apr 11 18:16:53 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:16:53 user nova-compute[82009]:         </nova:port>
Apr 11 18:16:53 user nova-compute[82009]:       </nova:ports>
Apr 11 18:16:53 user nova-compute[82009]:     </nova:instance>
Apr 11 18:16:53 user nova-compute[82009]:   </metadata>
Apr 11 18:16:53 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:16:53 user nova-compute[82009]:     <system>
Apr 11 18:16:53 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:16:53 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:16:53 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:16:53 user nova-compute[82009]:       <entry name="serial">2fdbfe12-0376-480d-a63d-7db4a2ac2243</entry>
Apr 11 18:16:53 user nova-compute[82009]:       <entry name="uuid">2fdbfe12-0376-480d-a63d-7db4a2ac2243</entry>
Apr 11 18:16:53 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:16:53 user nova-compute[82009]:     </system>
Apr 11 18:16:53 user nova-compute[82009]:   </sysinfo>
Apr 11 18:16:53 user nova-compute[82009]:   <os>
Apr 11 18:16:53 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:16:53 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:16:53 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:16:53 user nova-compute[82009]:   </os>
Apr 11 18:16:53 user nova-compute[82009]:   <features>
Apr 11 18:16:53 user nova-compute[82009]:     <acpi/>
Apr 11 18:16:53 user nova-compute[82009]:     <apic/>
Apr 11 18:16:53 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:16:53 user nova-compute[82009]:   </features>
Apr 11 18:16:53 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:16:53 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:16:53 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:16:53 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:16:53 user nova-compute[82009]:   </clock>
Apr 11 18:16:53 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:16:53 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:16:53 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:16:53 user nova-compute[82009]:   </cpu>
Apr 11 18:16:53 user nova-compute[82009]:   <devices>
Apr 11 18:16:53 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:16:53 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:16:53 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk"/>
Apr 11 18:16:53 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:16:53 user nova-compute[82009]:     </disk>
Apr 11 18:16:53 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:16:53 user nova-compute[82009]:       <mac address="fa:16:3e:81:e9:e2"/>
Apr 11 18:16:53 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:16:53 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:16:53 user nova-compute[82009]:       <target dev="tap8fbca9dd-8f"/>
Apr 11 18:16:53 user nova-compute[82009]:     </interface>
Apr 11 18:16:53 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:16:53 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/console.log" append="off"/>
Apr 11 18:16:53 user nova-compute[82009]:     </serial>
Apr 11 18:16:53 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:16:53 user nova-compute[82009]:     <video>
Apr 11 18:16:53 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:16:53 user nova-compute[82009]:     </video>
Apr 11 18:16:53 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:16:53 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:16:53 user nova-compute[82009]:     </rng>
Apr 11 18:16:53 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:16:53 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:16:53 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:16:53 user nova-compute[82009]:     </memballoon>
Apr 11 18:16:53 user nova-compute[82009]:   </devices>
Apr 11 18:16:53 user nova-compute[82009]: </domain>
Apr 11 18:16:53 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-909573337',display_name='tempest-VolumesAdminNegativeTest-server-909573337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-909573337',id=21,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad8dd512b7424fbe996ecbd18d11471e',ramdisk_id='',reservation_id='r-6x6vrm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-298923704',owner_user_name='tempest-VolumesAdminNegativeTest-298923704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:16:51Z,user_data=None,user_id='d20726e00e3743168e32eafe43318e20',uuid=2fdbfe12-0376-480d-a63d-7db4a2ac2243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converting VIF {"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG os_vif [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbca9dd-8f, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fbca9dd-8f, col_values=(('external_ids', {'iface-id': '8fbca9dd-8f56-4336-be2e-7341f550e2a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:e9:e2', 'vm-uuid': '2fdbfe12-0376-480d-a63d-7db4a2ac2243'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:53 user nova-compute[82009]: INFO os_vif [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f')
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] No VIF found with MAC fa:16:3e:81:e9:e2, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.neutron [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Updated VIF entry in instance network info cache for port 8fbca9dd-8f56-4336-be2e-7341f550e2a7. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.network.neutron [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Updating instance_info_cache with network_info: [{"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-96bd9ad9-5e6c-4156-85a3-7177546a0dcb req-0ddaad0a-9b18-4bf0-a1ca-cf832e754f7a service nova] Releasing lock "refresh_cache-2fdbfe12-0376-480d-a63d-7db4a2ac2243" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Skipping network cache update for instance because it is Building. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.compute.manager [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing instance network info cache due to event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.network.neutron [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.network.neutron [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updated VIF entry in instance network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.network.neutron [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d4245f30-b05a-4b77-bbe6-231698b4d3af req-b4afce11-1c11-474e-98b9-50f1292431cf service nova] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:16:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:16:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:16:54 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c57116-7ce5-4b43-bb8f-2ebe1013efa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:16:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ccfb9-87a7-412c-9c1d-6d234a98ee43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083] added
Apr 11 18:16:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7ae17c-d1dc-4834-8c7d-bdce46c0fb75]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a9818-7a4c-4b34-bb23-e2df5cff3977]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmCruaDR {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmCruaDR" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfbdc27-3c4a-4fbf-b9b6-051954082581]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmCruaDR'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a1a80-e221-4a87-964b-32aa62170a3f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245b08e-2018-49c4-bb1f-f35bcc398d1d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:16:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:16:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:55 user nova-compute[82009]: WARNING nova.compute.manager [req-ac42697e-a514-4d02-a67d-9665e09bb711 req-45cac19a-7c81-4f1e-b43d-7579df4f716e service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received unexpected event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with vm_state building and task_state spawning.
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd003fd-33f4-4db0-b3be-d1ee6a46f84c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]
Apr 11 18:16:55 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.
Apr 11 18:16:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee9d18-b58b-4d32-a95c-7f541d2bd39a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51d7911-a54c-44b0-9ad7-d3ec8bbe40a5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:16:55 user nova-compute[82009]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:16:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:16:55 user nova-compute[82009]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:16:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a79dab-618f-4c88-8baf-b5f153fe8bba]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:16:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26234353339653234', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234353339653234', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:16:56 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:16:56 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:16:56 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:16:56 user nova-compute[82009]:   <serial>7fcd6aab-4190-481d-bea1-4aff73c18083</serial>
Apr 11 18:16:56 user nova-compute[82009]: </disk>
Apr 11 18:16:56 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:56 user nova-compute[82009]: INFO nova.compute.manager [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Shelving
Apr 11 18:16:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No VIF found with MAC fa:16:3e:8b:69:25, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-63110fff-dbc6-4341-824e-75f6dc2f6232 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.695s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-unplugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-unplugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:56 user nova-compute[82009]: WARNING nova.compute.manager [req-73541a8f-ba21-411f-a650-30453b521f7b req-7b717405-70c7-469b-9fea-b62086d824f3 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-unplugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state active and task_state shelving.
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:56 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237017.0230846, 2fdbfe12-0376-480d-a63d-7db4a2ac2243 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] VM Resumed (Lifecycle Event)
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Instance spawned successfully.
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237017.0261874, 2fdbfe12-0376-480d-a63d-7db4a2ac2243 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] VM Started (Lifecycle Event)
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:57 user nova-compute[82009]: WARNING nova.compute.manager [req-1225ec40-a6ab-4a8f-9875-4e380649bc49 req-79baf0b8-6c72-437b-9a70-17cf32a5d4dd service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received unexpected event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with vm_state building and task_state spawning.
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.compute.manager [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Took 7.26 seconds to build instance.
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cd2d145-e821-4589-b197-2451bb8188d2 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.372s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance destroyed successfully.
Apr 11 18:16:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Beginning cold snapshot process
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk /opt/stack/data/nova/instances/snapshots/tmpz88ghokt/4fde265479e1476995d3bc2b81a53f24 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82009) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:16:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk /opt/stack/data/nova/instances/snapshots/tmpz88ghokt/4fde265479e1476995d3bc2b81a53f24" returned: 0 in 0.445s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Snapshot extracted, beginning image upload
Apr 11 18:16:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:58 user nova-compute[82009]: WARNING nova.compute.manager [req-c5fc83b4-060d-494f-a1a5-2ad772a06095 req-5682e2d2-354b-45fa-b1b5-f8f11538423f service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state active and task_state powering-off.
Apr 11 18:16:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance destroyed successfully.
Apr 11 18:16:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:16:58 user nova-compute[82009]: WARNING nova.compute.manager [req-9a9a10ff-e686-4333-8be9-473395edfb04 req-2497459c-c60a-4006-9a9e-473bc27a1b1a service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dbb2023c-1580-4467-8dd5-709be433cf39 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.984s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:16:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:00 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Snapshot image upload complete
Apr 11 18:17:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:00 user nova-compute[82009]: WARNING nova.compute.manager [req-df551a9b-85c5-4a03-909c-91ddb43983f9 req-a00ff7bf-525f-476e-aa49-377fe3749652 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state stopped and task_state None.
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:00 user nova-compute[82009]: INFO nova.compute.manager [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Shelve offloading
Apr 11 18:17:00 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance destroyed successfully.
Apr 11 18:17:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:01 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:17:01 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7576MB free_disk=26.421600341796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance destroyed successfully.
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'resources' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1005799066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1005799066',id=18,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9a9nPmAjerdldl6YPoScXwpgamwr3rJP1TIHx991AR4t6+N4RmymMGiHE3v2lIBtDFvIO76lEEbpVn4KSmVi5IAdIIF3VrPq8fW57dXsGj5RDaIQss3YEolDQ5cNSocQ==',key_name='tempest-keypair-504297625',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-i8mh72dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member',shelved_at='2023-04-11T18:17:00.425475',shelved_host='user',shelved_image_id='6404c11d-9a1a-4083-a0cf-5265675d1166'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=582e004b-a2f3-4397-9ccb-d23f5724ebe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG os_vif [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85d33cf-42, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:01 user nova-compute[82009]: INFO os_vif [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42')
Apr 11 18:17:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Deleting instance files /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1_del
Apr 11 18:17:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Deletion of /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1_del complete
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:17:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:17:01 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Deleted allocations for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:02 user nova-compute[82009]: INFO nova.compute.manager [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Detaching volume e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:17:02 user nova-compute[82009]: INFO nova.virt.block_device [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attempting to driver detach volume e18a0321-da20-41e7-b97b-7350ae176fc5 from mountpoint /dev/vdb
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Attempting to detach device vdb from instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:17:02 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:17:02 user nova-compute[82009]:   <source dev="/dev/sde"/>
Apr 11 18:17:02 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:17:02 user nova-compute[82009]:   <serial>e18a0321-da20-41e7-b97b-7350ae176fc5</serial>
Apr 11 18:17:02 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:17:02 user nova-compute[82009]: </disk>
Apr 11 18:17:02 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:17:02 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully detached device vdb from instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 from the persistent domain config.
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:17:02 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:17:02 user nova-compute[82009]:   <source dev="/dev/sde"/>
Apr 11 18:17:02 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:17:02 user nova-compute[82009]:   <serial>e18a0321-da20-41e7-b97b-7350ae176fc5</serial>
Apr 11 18:17:02 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:17:02 user nova-compute[82009]: </disk>
Apr 11 18:17:02 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.417s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.objects.instance [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'numa_topology' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing instance network info cache due to event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.network.neutron [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-5a036341-b413-4356-a704-c5580b561899 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.322s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237022.8783286, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:17:02 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully detached device vdb from instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 from the live domain config.
Apr 11 18:17:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrxfaYHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:17:02 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e44fccf-ba72-44fe-a4a6-15f23abfe346]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:17:02 user nova-compute[82009]: No targets found.
Apr 11 18:17:02 user nova-compute[82009]: iSNS:
Apr 11 18:17:02 user nova-compute[82009]: No targets found.
Apr 11 18:17:02 user nova-compute[82009]: STATIC:
Apr 11 18:17:02 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5
Apr 11 18:17:02 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:17:02 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:17:02 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:17:02 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:17:02 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:17:02 user nova-compute[82009]: FIRMWARE:
Apr 11 18:17:02 user nova-compute[82009]: No targets found.
Apr 11 18:17:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:17:02 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:17:02 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7304740-3968-450c-b972-b6672d9545da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[574115b4-38dd-42e8-ad71-8f9591482042]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:17:02 user nova-compute[82009]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 (non-flash)
Apr 11 18:17:02 user nova-compute[82009]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d81577f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5'): ({'sde'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sde {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c3dd2-56cd-4704-822f-5c85020ddc8d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updated VIF entry in instance network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf85d33cf-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a93683-61ac-4b17-81d7-3893cdb1a345]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sde {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1cb212e1-d72c-4cba-965d-c780f3eb53be req-10d86c6d-797d-4ce2-a7f1-503a59ad85b4 service nova] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2250fb78-201d-4612-a397-9659b7cb29b8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10354fd-e339-41a7-8634-654f1889fa26]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03ba626-30b4-4c85-9a30-a45f7d24bda1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e3542-220c-4b4d-bcde-ab85f6d3c7ad]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260]
Apr 11 18:17:03 user nova-compute[82009]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5, portal: 172.16.0.220,3260] successful.
Apr 11 18:17:03 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e18a0321-da20-41e7-b97b-7350ae176fc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c31ab-c1ad-4e6a-82e6-a29d01743650]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (274ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG nova.objects.instance [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'flavor' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-858436d9-6c65-4fc4-a705-4d09cf803a93 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-changed-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Refreshing instance network info cache due to event network-changed-ca931e62-5efe-439f-831c-1792c67eae7f. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Acquiring lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Acquired lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Refreshing network info cache for port ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'flavor' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:07 user nova-compute[82009]: INFO nova.compute.manager [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Attaching volume 30162a26-a276-44ab-8f84-434ae2dde3e9 to /dev/vdb
Apr 11 18:17:07 user nova-compute[82009]: DEBUG os_brick.utils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ca2b7-67b1-481d-a58d-021f006ba33a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419c899-fe42-43bf-a7d6-772bd880ec7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbac65ff-b57e-4227-ae13-014ff27b782c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821d431-0a51-42bb-8c45-ae052cbf2f0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:17:07 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:17:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7718e4ec-e294-42a9-8a13-70825094b3dc]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG os_brick.utils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:17:07 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating existing volume attachment record: 69d76192-7f99-4a6e-9a6b-1271c41e5ea9 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updated VIF entry in instance network info cache for port ca931e62-5efe-439f-831c-1792c67eae7f. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-05f8c2e1-b4d8-46ff-a24d-85cda837f7fa req-dd7fadb6-55be-4108-94bc-56357916a489 service nova] Releasing lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:17:08 user nova-compute[82009]: INFO nova.compute.claims [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Claim successful on node user
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:09 user nova-compute[82009]: INFO nova.compute.manager [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Terminating instance
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:17:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:09 user nova-compute[82009]: INFO nova.compute.manager [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Unshelving
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.policy [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd1c4ded6c544d6eb16e9086c6259750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e133c013140e1a17804737f4e3ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:09 user nova-compute[82009]: INFO nova.virt.block_device [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Booting with volume c2cc9035-772b-48ee-8fd4-b89cd9319142 at /dev/vda
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:17:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Creating image(s)
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "/opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "/opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "/opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c753de0-7e9d-43bd-925c-22d70ad15671]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-83c373d2-5f96-41fa-bc03-79d461004ea1 req-6fdcd634-6a11-403b-95a9-7a295e339856 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-unplugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Instance destroyed successfully.
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lazy-loading 'resources' on Instance uuid 1f3000ca-5a67-4814-bf9d-94415c8f3d9d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d793d9-b875-49ac-a495-bb3f64cbcdf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1977485148',display_name='tempest-ServerStableDeviceRescueTest-server-1977485148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1977485148',id=5,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfbRQOA+YTKOQ+lZdoJpkrj7VvUUe/6HtKV2apcueDmrB+0261QbqAV8wZxYggyb2JZ0aCJhf8E6yndBbQDy5N2d5vbP3AMf66KfCVAJDPoSHsP3ioPNDUjt3X0FB0lfw==',key_name='tempest-keypair-1352570335',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='964624241aac4d7ba6b2b9ffca6e7d8a',ramdisk_id='',reservation_id='r-vc38xagz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-465398083',owner_user_name='tempest-ServerStableDeviceRescueTest-465398083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e62201c2b4e4763bae71280d81ff5e4',uuid=1f3000ca-5a67-4814-bf9d-94415c8f3d9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converting VIF {"id": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "address": "fa:16:3e:c5:06:91", "network": {"id": "1b2fd4c9-6e15-4279-b820-328bb377d778", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-698348892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "964624241aac4d7ba6b2b9ffca6e7d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8be7e2fa-af", "ovs_interfaceid": "8be7e2fa-afa5-4bb3-a32b-95a701a17a65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG os_vif [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8be7e2fa-af, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af78b45-75e0-462f-a1ef-a6c7df7f1a2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5649b204-981a-4cac-85d5-267ffab38fc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.part --force-share --output=json" returned: 0 in 0.190s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.virt.images [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ae202131-1e90-4b52-a842-aa146ab12536 was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.part /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:17:10 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ebeb91-c55d-4b17-b11f-3e5661d852c6]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:10 user nova-compute[82009]: INFO os_vif [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:91,bridge_name='br-int',has_traffic_filtering=True,id=8be7e2fa-afa5-4bb3-a32b-95a701a17a65,network=Network(1b2fd4c9-6e15-4279-b820-328bb377d778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8be7e2fa-af')
Apr 11 18:17:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Deleting instance files /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d_del
Apr 11 18:17:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Deletion of /opt/stack/data/nova/instances/1f3000ca-5a67-4814-bf9d-94415c8f3d9d_del complete
Apr 11 18:17:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG os_brick.utils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] <== get_connector_properties: return (588ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating existing volume attachment record: daa7f650-dcc7-430b-80e4-343890681640 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: INFO nova.compute.manager [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Successfully created port: 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.part /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.converted" returned: 0 in 0.339s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.082s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1,backing_fmt=raw /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1,backing_fmt=raw /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk 1073741824" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:11 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Took 0.96 seconds to deallocate network for instance.
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Cannot resize image /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'migration_context' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Ensure instance console log exists: /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Successfully updated port: 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing instance network info cache due to event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyWnMXgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:17:11 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:17:11 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:17:11 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbac735-f16f-4647-89c1-d8a025be69f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:17:11 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1920ff-5813-4f2d-90a8-e9e15e8cd03d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9] added
Apr 11 18:17:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Deleted allocations for instance 1f3000ca-5a67-4814-bf9d-94415c8f3d9d
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Acquiring lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] No waiting events found dispatching network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:11 user nova-compute[82009]: WARNING nova.compute.manager [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received unexpected event network-vif-plugged-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 for instance with vm_state deleted and task_state None.
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-44342819-3c28-430f-93cb-ca43761d8661 req-dfa009ef-e10a-40c7-8e34-043c16980818 service nova] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Received event network-vif-deleted-8be7e2fa-afa5-4bb3-a32b-95a701a17a65 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8af33-671c-4811-b083-d5fb426d2cf2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2149668-4dec-4355-8f93-6e0097d205a5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyWnMXgm {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyWnMXgm" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a2eba-b102-452e-baf9-0b13a71b6349]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyWnMXgm'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6f75c0d4-e2c8-49bd-91ca-11de6dd4999f tempest-ServerStableDeviceRescueTest-465398083 tempest-ServerStableDeviceRescueTest-465398083-project-member] Lock "1f3000ca-5a67-4814-bf9d-94415c8f3d9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.687s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8fdbe-449f-4c6b-9459-6f38c7abe772]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d6779-8211-40b1-8d2c-d0c476ff3483]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance network_info: |[{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.neutron [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Start _get_guest_xml network_info=[{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:17:05Z,direct_url=<?>,disk_format='qcow2',id=ae202131-1e90-4b52-a842-aa146ab12536,min_disk=0,min_ram=0,name='tempest-scenario-img--2056849962',owner='a70e133c013140e1a17804737f4e3ef7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:17:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ae202131-1e90-4b52-a842-aa146ab12536'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:17:11 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:17:11 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:17:05Z,direct_url=<?>,disk_format='qcow2',id=ae202131-1e90-4b52-a842-aa146ab12536,min_disk=0,min_ram=0,name='tempest-scenario-img--2056849962',owner='a70e133c013140e1a17804737f4e3ef7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:17:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412604929',display_name='tempest-TestMinimumBasicScenario-server-1412604929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412604929',id=22,image_ref='ae202131-1e90-4b52-a842-aa146ab12536',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0dOv+vq9gsgidD6e8GZkhomJp382UjYsmrw934PhdaAUHmUcG7KAhr8HRtwnN2nsKzabe5u5w0n4NM+BgKevuPnPr+IH9jOhoaX2NUYaoSjcye13Ow4Y+ibxlYeX9n8Q==',key_name='tempest-TestMinimumBasicScenario-654518614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-6kg5qfvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae202131-1e90-4b52-a842-aa146ab12536',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:17:09Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=7296c02e-f468-45b9-b037-e6cd240dd27d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'pci_devices' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e95d06a-f5e5-4255-b666-39b7dd74692f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260]
Apr 11 18:17:11 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260] successful.
Apr 11 18:17:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:17:11 user nova-compute[82009]:   <uuid>7296c02e-f468-45b9-b037-e6cd240dd27d</uuid>
Apr 11 18:17:11 user nova-compute[82009]:   <name>instance-00000016</name>
Apr 11 18:17:11 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:17:11 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:17:11 user nova-compute[82009]:   <metadata>
Apr 11 18:17:11 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:17:11 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:17:11 user nova-compute[82009]:       <nova:name>tempest-TestMinimumBasicScenario-server-1412604929</nova:name>
Apr 11 18:17:11 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:17:11</nova:creationTime>
Apr 11 18:17:11 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:17:11 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:17:11 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:17:11 user nova-compute[82009]:       <nova:owner>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:user uuid="dd1c4ded6c544d6eb16e9086c6259750">tempest-TestMinimumBasicScenario-492134328-project-member</nova:user>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:project uuid="a70e133c013140e1a17804737f4e3ef7">tempest-TestMinimumBasicScenario-492134328</nova:project>
Apr 11 18:17:11 user nova-compute[82009]:       </nova:owner>
Apr 11 18:17:11 user nova-compute[82009]:       <nova:root type="image" uuid="ae202131-1e90-4b52-a842-aa146ab12536"/>
Apr 11 18:17:11 user nova-compute[82009]:       <nova:ports>
Apr 11 18:17:11 user nova-compute[82009]:         <nova:port uuid="23c3497e-9e98-496c-b81b-3ce400105b1b">
Apr 11 18:17:11 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:17:11 user nova-compute[82009]:         </nova:port>
Apr 11 18:17:11 user nova-compute[82009]:       </nova:ports>
Apr 11 18:17:11 user nova-compute[82009]:     </nova:instance>
Apr 11 18:17:11 user nova-compute[82009]:   </metadata>
Apr 11 18:17:11 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:17:11 user nova-compute[82009]:     <system>
Apr 11 18:17:11 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:17:11 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:17:11 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:17:11 user nova-compute[82009]:       <entry name="serial">7296c02e-f468-45b9-b037-e6cd240dd27d</entry>
Apr 11 18:17:11 user nova-compute[82009]:       <entry name="uuid">7296c02e-f468-45b9-b037-e6cd240dd27d</entry>
Apr 11 18:17:11 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:17:11 user nova-compute[82009]:     </system>
Apr 11 18:17:11 user nova-compute[82009]:   </sysinfo>
Apr 11 18:17:11 user nova-compute[82009]:   <os>
Apr 11 18:17:11 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:17:11 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:17:11 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:17:11 user nova-compute[82009]:   </os>
Apr 11 18:17:11 user nova-compute[82009]:   <features>
Apr 11 18:17:11 user nova-compute[82009]:     <acpi/>
Apr 11 18:17:11 user nova-compute[82009]:     <apic/>
Apr 11 18:17:11 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:17:11 user nova-compute[82009]:   </features>
Apr 11 18:17:11 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:17:11 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:17:11 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:17:11 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:17:11 user nova-compute[82009]:   </clock>
Apr 11 18:17:11 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:17:11 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:17:11 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:17:11 user nova-compute[82009]:   </cpu>
Apr 11 18:17:11 user nova-compute[82009]:   <devices>
Apr 11 18:17:11 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:17:11 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:17:11 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk"/>
Apr 11 18:17:11 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:17:11 user nova-compute[82009]:     </disk>
Apr 11 18:17:11 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:17:11 user nova-compute[82009]:       <mac address="fa:16:3e:33:a4:b3"/>
Apr 11 18:17:11 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:17:11 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:17:11 user nova-compute[82009]:       <target dev="tap23c3497e-9e"/>
Apr 11 18:17:11 user nova-compute[82009]:     </interface>
Apr 11 18:17:11 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:17:11 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/console.log" append="off"/>
Apr 11 18:17:11 user nova-compute[82009]:     </serial>
Apr 11 18:17:11 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:17:11 user nova-compute[82009]:     <video>
Apr 11 18:17:11 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:17:11 user nova-compute[82009]:     </video>
Apr 11 18:17:11 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:17:11 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:17:11 user nova-compute[82009]:     </rng>
Apr 11 18:17:11 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:17:11 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:17:11 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:17:11 user nova-compute[82009]:     </memballoon>
Apr 11 18:17:11 user nova-compute[82009]:   </devices>
Apr 11 18:17:11 user nova-compute[82009]: </domain>
Apr 11 18:17:11 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412604929',display_name='tempest-TestMinimumBasicScenario-server-1412604929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412604929',id=22,image_ref='ae202131-1e90-4b52-a842-aa146ab12536',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0dOv+vq9gsgidD6e8GZkhomJp382UjYsmrw934PhdaAUHmUcG7KAhr8HRtwnN2nsKzabe5u5w0n4NM+BgKevuPnPr+IH9jOhoaX2NUYaoSjcye13Ow4Y+ibxlYeX9n8Q==',key_name='tempest-TestMinimumBasicScenario-654518614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-6kg5qfvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae202131-1e90-4b52-a842-aa146ab12536',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:17:09Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=7296c02e-f468-45b9-b037-e6cd240dd27d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_vif [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23c3497e-9e, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23c3497e-9e, col_values=(('external_ids', {'iface-id': '23c3497e-9e98-496c-b81b-3ce400105b1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:a4:b3', 'vm-uuid': '7296c02e-f468-45b9-b037-e6cd240dd27d'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85beff2b-a7d4-4e94-8010-70e4724954db]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:12 user nova-compute[82009]: INFO os_vif [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e')
Apr 11 18:17:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06948a1-22ee-446c-97cd-49a62f5b3424]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:12 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:12 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f38032-0ef5-40f1-84e9-7211120ae60b]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyWnMXgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No VIF found with MAC fa:16:3e:33:a4:b3, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237017.366069, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:12 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] VM Stopped (Lifecycle Event)
Apr 11 18:17:12 user nova-compute[82009]: DEBUG nova.network.neutron [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updated VIF entry in instance network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG nova.network.neutron [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG nova.compute.manager [None req-453fedce-1dd3-41d1-a938-c01f62ee4c94 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8c70c58d-e426-471e-bfd1-5128b9ebcf5d req-d8bd1485-f7bb-4a10-acf6-ae5509cd9e61 service nova] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26166363362326435', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166363362326435', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'flavor' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:17:13 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:17:13 user nova-compute[82009]:   <source dev="/dev/sdc"/>
Apr 11 18:17:13 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:17:13 user nova-compute[82009]:   <serial>30162a26-a276-44ab-8f84-434ae2dde3e9</serial>
Apr 11 18:17:13 user nova-compute[82009]: </disk>
Apr 11 18:17:13 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:13 user nova-compute[82009]: WARNING nova.compute.manager [req-485c359c-c30b-40a7-a629-41b50c23fa08 req-855ff189-ff95-4a93-bf9c-29bf8b908c88 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state building and task_state spawning.
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No VIF found with MAC fa:16:3e:23:ef:f2, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237018.8412223, e7908f28-28c2-4b9a-b804-042f0d186691 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:13 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Stopped (Lifecycle Event)
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-34ff35f9-c4bf-4029-b5e9-9eee3f387843 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-34ff35f9-c4bf-4029-b5e9-9eee3f387843 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8cd7cfb2-0dc2-4526-85cc-eb4c107344c4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.939s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'pci_requests' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'numa_topology' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:14 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:17:14 user nova-compute[82009]: INFO nova.compute.claims [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Claim successful on node user
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:15 user nova-compute[82009]: INFO nova.network.neutron [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating port d870c097-5a51-464e-94e5-d29336bee09d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:15 user nova-compute[82009]: WARNING nova.compute.manager [req-5f29f4c3-4c48-4811-8845-c73574dabb2a req-9c552fab-7358-4f63-8aa4-494a071310af service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state building and task_state spawning.
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237035.9122977, 7296c02e-f468-45b9-b037-e6cd240dd27d => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] VM Resumed (Lifecycle Event)
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:17:15 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance spawned successfully.
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:17:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237035.915421, 7296c02e-f468-45b9-b037-e6cd240dd27d => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] VM Started (Lifecycle Event)
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-changed-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing instance network info cache due to event network-changed-d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Took 6.47 seconds to spawn the instance on the hypervisor.
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.compute.manager [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Detaching volume 30162a26-a276-44ab-8f84-434ae2dde3e9
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.virt.block_device [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Attempting to driver detach volume 30162a26-a276-44ab-8f84-434ae2dde3e9 from mountpoint /dev/vdb
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.compute.manager [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Took 7.46 seconds to build instance.
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Attempting to detach device vdb from instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:17:16 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:17:16 user nova-compute[82009]:   <source dev="/dev/sdc"/>
Apr 11 18:17:16 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:17:16 user nova-compute[82009]:   <serial>30162a26-a276-44ab-8f84-434ae2dde3e9</serial>
Apr 11 18:17:16 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:17:16 user nova-compute[82009]: </disk>
Apr 11 18:17:16 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully detached device vdb from instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 from the persistent domain config.
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:17:16 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:17:16 user nova-compute[82009]:   <source dev="/dev/sdc"/>
Apr 11 18:17:16 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:17:16 user nova-compute[82009]:   <serial>30162a26-a276-44ab-8f84-434ae2dde3e9</serial>
Apr 11 18:17:16 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:17:16 user nova-compute[82009]: </disk>
Apr 11 18:17:16 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ce492503-221f-4880-9998-fba07d60bbd3 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Creating image(s)
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Ensure instance console log exists: /opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Start _get_guest_xml network_info=[{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'daa7f650-dcc7-430b-80e4-343890681640', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2fef8f1e-9300-4bd6-8958-4386541a9c0c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2cc9035-772b-48ee-8fd4-b89cd9319142', 'serial': 'c2cc9035-772b-48ee-8fd4-b89cd9319142'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing network info cache for port d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:17:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:17:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.objects.instance [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:17:16 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:17:16 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:17:16 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d565b26-4483-4c1c-b9e7-d84ff1fdb4aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:17:16 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e549afe2-0e77-4cff-b42f-4b0833821f8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142] added
Apr 11 18:17:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237036.6045878, 91bf5195-b2bc-48ca-9632-5ae616090fd2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:17:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully detached device vdb from instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 from the live domain config.
Apr 11 18:17:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyWnMXgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:17:16 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c23c8-79a7-407f-a0e6-b42d5ef3f047]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a3955b-1dcd-4b7e-a55d-21cbef1d8995]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kESRZuIo {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kESRZuIo" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf08abe-8cf9-43e1-9322-1836899747be]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kESRZuIo'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f33bf-5ae7-446f-a9b3-8d72512c9229]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffede9c9-2dd2-46c3-99a2-458303a35c56]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c539a10-1b38-4646-9098-e0ac57965212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]
Apr 11 18:17:16 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.
Apr 11 18:17:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59f0b21-1a17-454a-be5a-ced329d6a5ee]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[afba5889-218f-47f4-97af-19279166414a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:17:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d3f973-1ac5-4524-b412-3838a8d0da8d]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:17:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updated VIF entry in instance network info cache for port d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a1b7ae7a-a729-4dce-9a04-240345bcb53e req-eb601d38-1d79-4b87-bae6-c56b9f89f481 service nova] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26133613830333863', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133613830333863', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.276s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd257a7-33c3-4639-ac8b-4ce3f20bd999]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:17:17 user nova-compute[82009]: No targets found.
Apr 11 18:17:17 user nova-compute[82009]: iSNS:
Apr 11 18:17:17 user nova-compute[82009]: No targets found.
Apr 11 18:17:17 user nova-compute[82009]: STATIC:
Apr 11 18:17:17 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:17:17 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:17:17 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:17:17 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9
Apr 11 18:17:17 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:17:17 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:17:17 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:17:17 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:17:17 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:17:17 user nova-compute[82009]: FIRMWARE:
Apr 11 18:17:17 user nova-compute[82009]: No targets found.
Apr 11 18:17:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:17:17 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:17:17 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1554900069',display_name='tempest-TestShelveInstance-server-1554900069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1554900069',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1371472427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6090bfb65d0c4afeb5ac38c45083799d',ramdisk_id='',reservation_id='r-trhuh3i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-839951281',owner_user_name='tempest-TestShelveInstance-839951281-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:17:10Z,user_data=None,user_id='43dc7c5c888247029ff6adedbdb2e938',uuid=2fef8f1e-9300-4bd6-8958-4386541a9c0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converting VIF {"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.objects.instance [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:17:17 user nova-compute[82009]:   <uuid>2fef8f1e-9300-4bd6-8958-4386541a9c0c</uuid>
Apr 11 18:17:17 user nova-compute[82009]:   <name>instance-0000000d</name>
Apr 11 18:17:17 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:17:17 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:17:17 user nova-compute[82009]:   <metadata>
Apr 11 18:17:17 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:17:17 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:17:17 user nova-compute[82009]:       <nova:name>tempest-TestShelveInstance-server-1554900069</nova:name>
Apr 11 18:17:17 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:17:16</nova:creationTime>
Apr 11 18:17:17 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:17:17 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:17:17 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:17:17 user nova-compute[82009]:       <nova:owner>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:user uuid="43dc7c5c888247029ff6adedbdb2e938">tempest-TestShelveInstance-839951281-project-member</nova:user>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:project uuid="6090bfb65d0c4afeb5ac38c45083799d">tempest-TestShelveInstance-839951281</nova:project>
Apr 11 18:17:17 user nova-compute[82009]:       </nova:owner>
Apr 11 18:17:17 user nova-compute[82009]:       <nova:ports>
Apr 11 18:17:17 user nova-compute[82009]:         <nova:port uuid="d870c097-5a51-464e-94e5-d29336bee09d">
Apr 11 18:17:17 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:17:17 user nova-compute[82009]:         </nova:port>
Apr 11 18:17:17 user nova-compute[82009]:       </nova:ports>
Apr 11 18:17:17 user nova-compute[82009]:     </nova:instance>
Apr 11 18:17:17 user nova-compute[82009]:   </metadata>
Apr 11 18:17:17 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:17:17 user nova-compute[82009]:     <system>
Apr 11 18:17:17 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:17:17 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:17:17 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:17:17 user nova-compute[82009]:       <entry name="serial">2fef8f1e-9300-4bd6-8958-4386541a9c0c</entry>
Apr 11 18:17:17 user nova-compute[82009]:       <entry name="uuid">2fef8f1e-9300-4bd6-8958-4386541a9c0c</entry>
Apr 11 18:17:17 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:17:17 user nova-compute[82009]:     </system>
Apr 11 18:17:17 user nova-compute[82009]:   </sysinfo>
Apr 11 18:17:17 user nova-compute[82009]:   <os>
Apr 11 18:17:17 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:17:17 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:17:17 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:17:17 user nova-compute[82009]:   </os>
Apr 11 18:17:17 user nova-compute[82009]:   <features>
Apr 11 18:17:17 user nova-compute[82009]:     <acpi/>
Apr 11 18:17:17 user nova-compute[82009]:     <apic/>
Apr 11 18:17:17 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:17:17 user nova-compute[82009]:   </features>
Apr 11 18:17:17 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:17:17 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:17:17 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:17:17 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:17:17 user nova-compute[82009]:   </clock>
Apr 11 18:17:17 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:17:17 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:17:17 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:17:17 user nova-compute[82009]:   </cpu>
Apr 11 18:17:17 user nova-compute[82009]:   <devices>
Apr 11 18:17:17 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:17:17 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:17:17 user nova-compute[82009]:       <source dev="/dev/sdd"/>
Apr 11 18:17:17 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:17:17 user nova-compute[82009]:       <serial>c2cc9035-772b-48ee-8fd4-b89cd9319142</serial>
Apr 11 18:17:17 user nova-compute[82009]:     </disk>
Apr 11 18:17:17 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:17:17 user nova-compute[82009]:       <mac address="fa:16:3e:7d:03:34"/>
Apr 11 18:17:17 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:17:17 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:17:17 user nova-compute[82009]:       <target dev="tapd870c097-5a"/>
Apr 11 18:17:17 user nova-compute[82009]:     </interface>
Apr 11 18:17:17 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:17:17 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c/console.log" append="off"/>
Apr 11 18:17:17 user nova-compute[82009]:     </serial>
Apr 11 18:17:17 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:17:17 user nova-compute[82009]:     <video>
Apr 11 18:17:17 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:17:17 user nova-compute[82009]:     </video>
Apr 11 18:17:17 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:17:17 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:17:17 user nova-compute[82009]:     </rng>
Apr 11 18:17:17 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:17:17 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:17:17 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:17:17 user nova-compute[82009]:     </memballoon>
Apr 11 18:17:17 user nova-compute[82009]:   </devices>
Apr 11 18:17:17 user nova-compute[82009]: </domain>
Apr 11 18:17:17 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1554900069',display_name='tempest-TestShelveInstance-server-1554900069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1554900069',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1371472427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6090bfb65d0c4afeb5ac38c45083799d',ramdisk_id='',reservation_id='r-trhuh3i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-839951281',owner_user_name='tempest-TestShelveInstance-839951281-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:17:10Z,user_data=None,user_id='43dc7c5c888247029ff6adedbdb2e938',uuid=2fef8f1e-9300-4bd6-8958-4386541a9c0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converting VIF {"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_vif [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[31824371-e543-4ab1-8ad5-bf81630759f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd870c097-5a, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd870c097-5a, col_values=(('external_ids', {'iface-id': 'd870c097-5a51-464e-94e5-d29336bee09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:03:34', 'vm-uuid': '2fef8f1e-9300-4bd6-8958-4386541a9c0c'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:17 user nova-compute[82009]: INFO os_vif [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a')
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43617e9-b82d-4a27-b360-b001c1351b9d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:17 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:17 user nova-compute[82009]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:17:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:17:17 user nova-compute[82009]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 (non-flash)
Apr 11 18:17:17 user nova-compute[82009]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:17:17 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6cc39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:17:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5efa57-9608-4b03-8c43-c1c9127d65b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] No VIF found with MAC fa:16:3e:7d:03:34, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc9ef09-9c99-4892-a243-710dbbedb5e8]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b092faf4-dc25-49c6-85b4-cefb8e275bf8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b4940d-d490-428d-ae15-3d75655237d8]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2afff2f-30b7-4811-bd43-b54a8deb2a26]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bab851-6406-4186-89fb-a3aff17c2cfa]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260]
Apr 11 18:17:18 user nova-compute[82009]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9, portal: 172.16.0.220,3260] successful.
Apr 11 18:17:18 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30162a26-a276-44ab-8f84-434ae2dde3e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1363c609-d986-421b-9f7a-9fdf82993cb0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] <== disconnect_volume: return (1615ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:17:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'flavor' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-edec57bc-6a33-44b9-af2d-f9a31b19d382 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.028s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:19 user nova-compute[82009]: WARNING nova.compute.manager [req-e5db96c2-4dbf-4ba6-b8d4-570fb82794d0 req-29e40ec8-59d8-4ef0-ac58-73cb2317ed63 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237041.3794513, 2fef8f1e-9300-4bd6-8958-4386541a9c0c => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] VM Resumed (Lifecycle Event)
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:17:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance spawned successfully.
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:17:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237041.3831773, 2fef8f1e-9300-4bd6-8958-4386541a9c0c => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] VM Started (Lifecycle Event)
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:17:21 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:17:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-942554ae-1e51-4227-b16f-4dca321b3b01 tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.154s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:17:21 user nova-compute[82009]: WARNING nova.compute.manager [req-a7917260-da42-4a96-982e-f074519359ed req-2910f9d0-97da-4beb-b4a9-ccac499cfac3 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state None.
Apr 11 18:17:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:25 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237030.0101068, 1f3000ca-5a67-4814-bf9d-94415c8f3d9d => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:17:25 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] VM Stopped (Lifecycle Event)
Apr 11 18:17:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-addac7a1-e434-4125-acf2-59d0e770e6a1 None None] [instance: 1f3000ca-5a67-4814-bf9d-94415c8f3d9d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:17:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:54 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:17:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:17:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:17:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:17:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:17:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:17:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:17:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:17:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:17:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:01 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:01 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7493MB free_disk=26.435504913330078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 7296c02e-f468-45b9-b037-e6cd240dd27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:18:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:18:02 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:18:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:02 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:18:02 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:18:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:18:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:08 user nova-compute[82009]: INFO nova.compute.manager [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] instance snapshotting
Apr 11 18:18:08 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Beginning live snapshot process
Apr 11 18:18:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json -f qcow2" returned: 0 in 0.159s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmaht1tsv/8b30039570054e00a199e0bc0e31fbe3.delta 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmaht1tsv/8b30039570054e00a199e0bc0e31fbe3.delta 1073741824" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 18:18:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:18:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:18:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 18:18:10 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:18:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmaht1tsv/8b30039570054e00a199e0bc0e31fbe3.delta /opt/stack/data/nova/instances/snapshots/tmpmaht1tsv/8b30039570054e00a199e0bc0e31fbe3 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmaht1tsv/8b30039570054e00a199e0bc0e31fbe3.delta /opt/stack/data/nova/instances/snapshots/tmpmaht1tsv/8b30039570054e00a199e0bc0e31fbe3" returned: 0 in 0.368s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Snapshot extracted, beginning image upload
Apr 11 18:18:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Snapshot image upload complete
Apr 11 18:18:13 user nova-compute[82009]: INFO nova.compute.manager [None req-c88c5170-9240-4f4d-8098-7c7c803cc014 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Took 5.09 seconds to snapshot the instance on the hypervisor.
Apr 11 18:18:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:18:16 user nova-compute[82009]: INFO nova.compute.claims [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Claim successful on node user
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:18:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:18:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG nova.policy [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c44e6b75d86f4ff0b6f93123ce15ccc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e02898b1bc4378822244d9522ff042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:18:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Creating image(s)
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "/opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "/opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "fb47537ccc2b0667cc911676ee08cc381e1c20db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "fb47537ccc2b0667cc911676ee08cc381e1c20db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Successfully created port: 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.part --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG nova.virt.images [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 041c5dfa-75b5-40fd-88b4-c15489d9c57b was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:18:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.part /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.part /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.converted" returned: 0 in 0.309s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "fb47537ccc2b0667cc911676ee08cc381e1c20db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.289s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "fb47537ccc2b0667cc911676ee08cc381e1c20db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "fb47537ccc2b0667cc911676ee08cc381e1c20db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db,backing_fmt=raw /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db,backing_fmt=raw /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk 1073741824" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "fb47537ccc2b0667cc911676ee08cc381e1c20db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'migration_context' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Ensure instance console log exists: /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Successfully updated port: 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquired lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-changed-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Refreshing instance network info cache due to event network-changed-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Acquiring lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updating instance_info_cache with network_info: [{"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Releasing lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Instance network_info: |[{"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Acquired lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.neutron [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Refreshing network info cache for port 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Start _get_guest_xml network_info=[{"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8e8415f641f63261c5136b06617baf70',container_format='bare',created_at=2023-04-11T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=041c5dfa-75b5-40fd-88b4-c15489d9c57b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-746341945',owner='86e02898b1bc4378822244d9522ff042',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T18:18:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '041c5dfa-75b5-40fd-88b4-c15489d9c57b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:18:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8e8415f641f63261c5136b06617baf70',container_format='bare',created_at=2023-04-11T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=041c5dfa-75b5-40fd-88b4-c15489d9c57b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-746341945',owner='86e02898b1bc4378822244d9522ff042',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T18:18:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2124334392',display_name='tempest-TestStampPattern-server-2124334392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2124334392',id=23,image_ref='041c5dfa-75b5-40fd-88b4-c15489d9c57b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA==',key_name='tempest-TestStampPattern-1363613236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86e02898b1bc4378822244d9522ff042',ramdisk_id='',reservation_id='r-1eoguptz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='91bf5195-b2bc-48ca-9632-5ae616090fd2',image_min_disk='1',image_min_ram='0',image_owner_id='86e02898b1bc4378822244d9522ff042',image_owner_project_name='tempest-TestStampPattern-1680133886',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1680133886-project-member',image_user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1680133886',owner_user_name='tempest-TestStampPattern-1680133886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:17Z,user_data=None,user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',uuid=e7b91dda-27c6-4bcd-99ec-c818c5c93373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converting VIF {"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'pci_devices' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:18:19 user nova-compute[82009]:   <uuid>e7b91dda-27c6-4bcd-99ec-c818c5c93373</uuid>
Apr 11 18:18:19 user nova-compute[82009]:   <name>instance-00000017</name>
Apr 11 18:18:19 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:18:19 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:18:19 user nova-compute[82009]:   <metadata>
Apr 11 18:18:19 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:18:19 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:18:19 user nova-compute[82009]:       <nova:name>tempest-TestStampPattern-server-2124334392</nova:name>
Apr 11 18:18:19 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:18:19</nova:creationTime>
Apr 11 18:18:19 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:18:19 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:18:19 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:18:19 user nova-compute[82009]:       <nova:owner>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:user uuid="c44e6b75d86f4ff0b6f93123ce15ccc0">tempest-TestStampPattern-1680133886-project-member</nova:user>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:project uuid="86e02898b1bc4378822244d9522ff042">tempest-TestStampPattern-1680133886</nova:project>
Apr 11 18:18:19 user nova-compute[82009]:       </nova:owner>
Apr 11 18:18:19 user nova-compute[82009]:       <nova:root type="image" uuid="041c5dfa-75b5-40fd-88b4-c15489d9c57b"/>
Apr 11 18:18:19 user nova-compute[82009]:       <nova:ports>
Apr 11 18:18:19 user nova-compute[82009]:         <nova:port uuid="4c4d2ca4-ad67-4059-ae14-fcaece35e4ed">
Apr 11 18:18:19 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:18:19 user nova-compute[82009]:         </nova:port>
Apr 11 18:18:19 user nova-compute[82009]:       </nova:ports>
Apr 11 18:18:19 user nova-compute[82009]:     </nova:instance>
Apr 11 18:18:19 user nova-compute[82009]:   </metadata>
Apr 11 18:18:19 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:18:19 user nova-compute[82009]:     <system>
Apr 11 18:18:19 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:18:19 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:18:19 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:18:19 user nova-compute[82009]:       <entry name="serial">e7b91dda-27c6-4bcd-99ec-c818c5c93373</entry>
Apr 11 18:18:19 user nova-compute[82009]:       <entry name="uuid">e7b91dda-27c6-4bcd-99ec-c818c5c93373</entry>
Apr 11 18:18:19 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:18:19 user nova-compute[82009]:     </system>
Apr 11 18:18:19 user nova-compute[82009]:   </sysinfo>
Apr 11 18:18:19 user nova-compute[82009]:   <os>
Apr 11 18:18:19 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:18:19 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:18:19 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:18:19 user nova-compute[82009]:   </os>
Apr 11 18:18:19 user nova-compute[82009]:   <features>
Apr 11 18:18:19 user nova-compute[82009]:     <acpi/>
Apr 11 18:18:19 user nova-compute[82009]:     <apic/>
Apr 11 18:18:19 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:18:19 user nova-compute[82009]:   </features>
Apr 11 18:18:19 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:18:19 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:18:19 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:18:19 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:18:19 user nova-compute[82009]:   </clock>
Apr 11 18:18:19 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:18:19 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:18:19 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:18:19 user nova-compute[82009]:   </cpu>
Apr 11 18:18:19 user nova-compute[82009]:   <devices>
Apr 11 18:18:19 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:18:19 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:18:19 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk"/>
Apr 11 18:18:19 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:18:19 user nova-compute[82009]:     </disk>
Apr 11 18:18:19 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:18:19 user nova-compute[82009]:       <mac address="fa:16:3e:0d:7a:a6"/>
Apr 11 18:18:19 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:18:19 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:18:19 user nova-compute[82009]:       <target dev="tap4c4d2ca4-ad"/>
Apr 11 18:18:19 user nova-compute[82009]:     </interface>
Apr 11 18:18:19 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:18:19 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/console.log" append="off"/>
Apr 11 18:18:19 user nova-compute[82009]:     </serial>
Apr 11 18:18:19 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:18:19 user nova-compute[82009]:     <video>
Apr 11 18:18:19 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:18:19 user nova-compute[82009]:     </video>
Apr 11 18:18:19 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:18:19 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:18:19 user nova-compute[82009]:     </rng>
Apr 11 18:18:19 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:18:19 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:18:19 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:18:19 user nova-compute[82009]:     </memballoon>
Apr 11 18:18:19 user nova-compute[82009]:   </devices>
Apr 11 18:18:19 user nova-compute[82009]: </domain>
Apr 11 18:18:19 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2124334392',display_name='tempest-TestStampPattern-server-2124334392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2124334392',id=23,image_ref='041c5dfa-75b5-40fd-88b4-c15489d9c57b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA==',key_name='tempest-TestStampPattern-1363613236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86e02898b1bc4378822244d9522ff042',ramdisk_id='',reservation_id='r-1eoguptz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='91bf5195-b2bc-48ca-9632-5ae616090fd2',image_min_disk='1',image_min_ram='0',image_owner_id='86e02898b1bc4378822244d9522ff042',image_owner_project_name='tempest-TestStampPattern-1680133886',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1680133886-project-member',image_user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',network_allocated='True',owner_project_name='tempest-TestStampPattern-1680133886',owner_user_name='tempest-TestStampPattern-1680133886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:17Z,user_data=None,user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',uuid=e7b91dda-27c6-4bcd-99ec-c818c5c93373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converting VIF {"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG os_vif [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c4d2ca4-ad, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c4d2ca4-ad, col_values=(('external_ids', {'iface-id': '4c4d2ca4-ad67-4059-ae14-fcaece35e4ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:7a:a6', 'vm-uuid': 'e7b91dda-27c6-4bcd-99ec-c818c5c93373'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:19 user nova-compute[82009]: INFO os_vif [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad')
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:18:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No VIF found with MAC fa:16:3e:0d:7a:a6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:18:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updated VIF entry in instance network info cache for port 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:18:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updating instance_info_cache with network_info: [{"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d2eac9c0-a5a8-47a6-9f4b-7fb73982980e req-46d5da7c-ca3e-45af-bed2-750e924b1339 service nova] Releasing lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] No waiting events found dispatching network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:21 user nova-compute[82009]: WARNING nova.compute.manager [req-e9734788-2382-4232-b206-6ec470c98b38 req-ba6a5288-0eef-4237-b7f6-2b4c24e5c417 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received unexpected event network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance with vm_state building and task_state spawning.
Apr 11 18:18:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237103.158442, e7b91dda-27c6-4bcd-99ec-c818c5c93373 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] VM Resumed (Lifecycle Event)
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Instance spawned successfully.
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237103.1623027, e7b91dda-27c6-4bcd-99ec-c818c5c93373 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] VM Started (Lifecycle Event)
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] No waiting events found dispatching network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:23 user nova-compute[82009]: WARNING nova.compute.manager [req-26d8464c-b1c9-4479-8bca-7f56b8a4a67c req-253c827c-82b5-4cb3-adf3-f88f1a8c655b service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received unexpected event network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance with vm_state building and task_state spawning.
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:18:23 user nova-compute[82009]: INFO nova.compute.manager [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Took 7.05 seconds to build instance.
Apr 11 18:18:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a3bb6ec9-1879-48c9-b967-1c1a535e4cf4 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.159s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:25 user nova-compute[82009]: INFO nova.compute.manager [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Terminating instance
Apr 11 18:18:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-vif-unplugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] No waiting events found dispatching network-vif-unplugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-3a0a96b0-4e04-412c-8741-d563cbac7d43 req-6234c6d3-8d84-42b9-b4c1-3a7421e7a346 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-vif-unplugged-bca9e38b-190a-4007-9778-58c7a8578078 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:18:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Instance destroyed successfully.
Apr 11 18:18:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lazy-loading 'resources' on Instance uuid 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1416952030',display_name='tempest-VolumesActionsTest-instance-1416952030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1416952030',id=20,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf13b304615f48ab88c64755c2795c99',ramdisk_id='',reservation_id='r-n9783c0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1596862779',owner_user_name='tempest-VolumesActionsTest-1596862779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:41Z,user_data=None,user_id='086769a77da24d95a54c35f917240664',uuid=9b2e9f51-531f-4f4c-a1ce-75e2cfd337df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converting VIF {"id": "bca9e38b-190a-4007-9778-58c7a8578078", "address": "fa:16:3e:88:78:55", "network": {"id": "a526bfae-fdf9-449e-acc6-1cf2215b735f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1760089252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf13b304615f48ab88c64755c2795c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca9e38b-19", "ovs_interfaceid": "bca9e38b-190a-4007-9778-58c7a8578078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG os_vif [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbca9e38b-19, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:26 user nova-compute[82009]: INFO os_vif [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:78:55,bridge_name='br-int',has_traffic_filtering=True,id=bca9e38b-190a-4007-9778-58c7a8578078,network=Network(a526bfae-fdf9-449e-acc6-1cf2215b735f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca9e38b-19')
Apr 11 18:18:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Deleting instance files /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df_del
Apr 11 18:18:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Deletion of /opt/stack/data/nova/instances/9b2e9f51-531f-4f4c-a1ce-75e2cfd337df_del complete
Apr 11 18:18:26 user nova-compute[82009]: INFO nova.compute.manager [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 18:18:26 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:26 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Took 0.56 seconds to deallocate network for instance.
Apr 11 18:18:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-1307275c-5257-41d0-849a-a25f399dc579 req-9ec78824-e75d-4067-a8d0-f4567f729dee service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-vif-deleted-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:27 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Deleted allocations for instance 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df
Apr 11 18:18:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeca5833-0fc9-423b-8794-79b18c35cbde tempest-VolumesActionsTest-1596862779 tempest-VolumesActionsTest-1596862779-project-member] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received event network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Acquiring lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] Lock "9b2e9f51-531f-4f4c-a1ce-75e2cfd337df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] No waiting events found dispatching network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:27 user nova-compute[82009]: WARNING nova.compute.manager [req-563f45cc-cd90-48af-8d9f-03c27c3cb6ff req-377632a7-dc65-4993-b8a0-46ad9d10f972 service nova] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Received unexpected event network-vif-plugged-bca9e38b-190a-4007-9778-58c7a8578078 for instance with vm_state deleted and task_state None.
Apr 11 18:18:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:18:32 user nova-compute[82009]: INFO nova.compute.claims [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Claim successful on node user
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:18:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.policy [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '908e0b5a1ce14f5cb636eda79ac77f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10b5a531bbc41d680d137a766a8b2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:18:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Creating image(s)
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk 1073741824" returned: 0 in 0.056s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Cannot resize image /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'migration_context' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Successfully created port: 2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Ensure instance console log exists: /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Successfully updated port: 2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing instance network info cache due to event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance network_info: |[{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Start _get_guest_xml network_info=[{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:18:34 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:34 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2027322626',display_name='tempest-ServerRescueNegativeTestJSON-server-2027322626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2027322626',id=24,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFIK5aPskfsOVBBGyw4yEbsLtMQvwJFTLOan+Twhh4tjr/C3BYu6u/4BceyXCRAua8zDa2ccvRw2H6FAdWFmjwazVukCovMZ6BukRUwqQ+pfLxuRzbwDkNupsMXFG9o8Q==',key_name='tempest-keypair-1641901033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-u5jbgqkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=c5a2e113-75f7-47ac-bdf9-458793a62061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'pci_devices' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:18:34 user nova-compute[82009]:   <uuid>c5a2e113-75f7-47ac-bdf9-458793a62061</uuid>
Apr 11 18:18:34 user nova-compute[82009]:   <name>instance-00000018</name>
Apr 11 18:18:34 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:18:34 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:18:34 user nova-compute[82009]:   <metadata>
Apr 11 18:18:34 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:18:34 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:18:34 user nova-compute[82009]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2027322626</nova:name>
Apr 11 18:18:34 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:18:34</nova:creationTime>
Apr 11 18:18:34 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:18:34 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:18:34 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:18:34 user nova-compute[82009]:       <nova:owner>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:user uuid="908e0b5a1ce14f5cb636eda79ac77f7b">tempest-ServerRescueNegativeTestJSON-223229619-project-member</nova:user>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:project uuid="c10b5a531bbc41d680d137a766a8b2d9">tempest-ServerRescueNegativeTestJSON-223229619</nova:project>
Apr 11 18:18:34 user nova-compute[82009]:       </nova:owner>
Apr 11 18:18:34 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:18:34 user nova-compute[82009]:       <nova:ports>
Apr 11 18:18:34 user nova-compute[82009]:         <nova:port uuid="2de8f180-0b9b-405b-abcd-f44d2c15a437">
Apr 11 18:18:34 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:18:34 user nova-compute[82009]:         </nova:port>
Apr 11 18:18:34 user nova-compute[82009]:       </nova:ports>
Apr 11 18:18:34 user nova-compute[82009]:     </nova:instance>
Apr 11 18:18:34 user nova-compute[82009]:   </metadata>
Apr 11 18:18:34 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:18:34 user nova-compute[82009]:     <system>
Apr 11 18:18:34 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:18:34 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:18:34 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:18:34 user nova-compute[82009]:       <entry name="serial">c5a2e113-75f7-47ac-bdf9-458793a62061</entry>
Apr 11 18:18:34 user nova-compute[82009]:       <entry name="uuid">c5a2e113-75f7-47ac-bdf9-458793a62061</entry>
Apr 11 18:18:34 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:18:34 user nova-compute[82009]:     </system>
Apr 11 18:18:34 user nova-compute[82009]:   </sysinfo>
Apr 11 18:18:34 user nova-compute[82009]:   <os>
Apr 11 18:18:34 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:18:34 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:18:34 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:18:34 user nova-compute[82009]:   </os>
Apr 11 18:18:34 user nova-compute[82009]:   <features>
Apr 11 18:18:34 user nova-compute[82009]:     <acpi/>
Apr 11 18:18:34 user nova-compute[82009]:     <apic/>
Apr 11 18:18:34 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:18:34 user nova-compute[82009]:   </features>
Apr 11 18:18:34 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:18:34 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:18:34 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:18:34 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:18:34 user nova-compute[82009]:   </clock>
Apr 11 18:18:34 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:18:34 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:18:34 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:18:34 user nova-compute[82009]:   </cpu>
Apr 11 18:18:34 user nova-compute[82009]:   <devices>
Apr 11 18:18:34 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:18:34 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:18:34 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk"/>
Apr 11 18:18:34 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:18:34 user nova-compute[82009]:     </disk>
Apr 11 18:18:34 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:18:34 user nova-compute[82009]:       <mac address="fa:16:3e:b5:43:66"/>
Apr 11 18:18:34 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:18:34 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:18:34 user nova-compute[82009]:       <target dev="tap2de8f180-0b"/>
Apr 11 18:18:34 user nova-compute[82009]:     </interface>
Apr 11 18:18:34 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:18:34 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/console.log" append="off"/>
Apr 11 18:18:34 user nova-compute[82009]:     </serial>
Apr 11 18:18:34 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:18:34 user nova-compute[82009]:     <video>
Apr 11 18:18:34 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:18:34 user nova-compute[82009]:     </video>
Apr 11 18:18:34 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:18:34 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:18:34 user nova-compute[82009]:     </rng>
Apr 11 18:18:34 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:18:34 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:18:34 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:18:34 user nova-compute[82009]:     </memballoon>
Apr 11 18:18:34 user nova-compute[82009]:   </devices>
Apr 11 18:18:34 user nova-compute[82009]: </domain>
Apr 11 18:18:34 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2027322626',display_name='tempest-ServerRescueNegativeTestJSON-server-2027322626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2027322626',id=24,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFIK5aPskfsOVBBGyw4yEbsLtMQvwJFTLOan+Twhh4tjr/C3BYu6u/4BceyXCRAua8zDa2ccvRw2H6FAdWFmjwazVukCovMZ6BukRUwqQ+pfLxuRzbwDkNupsMXFG9o8Q==',key_name='tempest-keypair-1641901033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-u5jbgqkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=c5a2e113-75f7-47ac-bdf9-458793a62061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG os_vif [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2de8f180-0b, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2de8f180-0b, col_values=(('external_ids', {'iface-id': '2de8f180-0b9b-405b-abcd-f44d2c15a437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:43:66', 'vm-uuid': 'c5a2e113-75f7-47ac-bdf9-458793a62061'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:34 user nova-compute[82009]: INFO os_vif [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b')
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:18:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:b5:43:66, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:18:35 user nova-compute[82009]: DEBUG nova.network.neutron [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updated VIF entry in instance network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:18:35 user nova-compute[82009]: DEBUG nova.network.neutron [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-345e0fb6-e663-4561-aeff-dfd39697a519 req-747c820c-8c7a-446a-8379-29d10a6d7361 service nova] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG nova.compute.manager [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:36 user nova-compute[82009]: DEBUG nova.compute.manager [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:36 user nova-compute[82009]: WARNING nova.compute.manager [req-df52ef69-d942-40d0-9d8f-14cf2b55b3d1 req-10411b7e-f944-45cb-bc9e-9b29a70b366a service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state building and task_state spawning.
Apr 11 18:18:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237118.412441, c5a2e113-75f7-47ac-bdf9-458793a62061 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Resumed (Lifecycle Event)
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance spawned successfully.
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237118.4134908, c5a2e113-75f7-47ac-bdf9-458793a62061 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Started (Lifecycle Event)
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Took 5.55 seconds to spawn the instance on the hypervisor.
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:38 user nova-compute[82009]: WARNING nova.compute.manager [req-0a3da713-893d-43f9-a767-3723fb35ca79 req-95b5d3ef-e0a8-4024-beaf-f58cac58e6b1 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state building and task_state spawning.
Apr 11 18:18:38 user nova-compute[82009]: INFO nova.compute.manager [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Took 6.32 seconds to build instance.
Apr 11 18:18:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f7c58562-8063-45dd-b5bb-bbb25b9721ac tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.415s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:40 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237105.9718559, 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:40 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] VM Stopped (Lifecycle Event)
Apr 11 18:18:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-eae24b5a-8d6a-464a-9273-65be2fe24d9f None None] [instance: 9b2e9f51-531f-4f4c-a1ce-75e2cfd337df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:42 user nova-compute[82009]: INFO nova.compute.manager [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Terminating instance
Apr 11 18:18:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-unplugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-unplugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-5709dbfc-9724-4819-9307-2b915ea36f22 req-07c961c0-b984-4224-b720-91ec4184f4dc service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-unplugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Instance destroyed successfully.
Apr 11 18:18:43 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'resources' on Instance uuid 2fdbfe12-0376-480d-a63d-7db4a2ac2243 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-909573337',display_name='tempest-VolumesAdminNegativeTest-server-909573337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-909573337',id=21,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad8dd512b7424fbe996ecbd18d11471e',ramdisk_id='',reservation_id='r-6x6vrm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-298923704',owner_user_name='tempest-VolumesAdminNegativeTest-298923704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:57Z,user_data=None,user_id='d20726e00e3743168e32eafe43318e20',uuid=2fdbfe12-0376-480d-a63d-7db4a2ac2243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converting VIF {"id": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "address": "fa:16:3e:81:e9:e2", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbca9dd-8f", "ovs_interfaceid": "8fbca9dd-8f56-4336-be2e-7341f550e2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG os_vif [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbca9dd-8f, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: INFO os_vif [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e9:e2,bridge_name='br-int',has_traffic_filtering=True,id=8fbca9dd-8f56-4336-be2e-7341f550e2a7,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbca9dd-8f')
Apr 11 18:18:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Deleting instance files /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243_del
Apr 11 18:18:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Deletion of /opt/stack/data/nova/instances/2fdbfe12-0376-480d-a63d-7db4a2ac2243_del complete
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: INFO nova.compute.manager [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 18:18:43 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:44 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:44 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Took 0.54 seconds to deallocate network for instance.
Apr 11 18:18:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-9d004480-91fe-44da-a10a-f41c60317b9d req-11ff6526-0c5a-420d-b981-5dc66301224f service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-deleted-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:44 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:18:44 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:18:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:44 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Deleted allocations for instance 2fdbfe12-0376-480d-a63d-7db4a2ac2243
Apr 11 18:18:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0c06bb98-99d9-4c89-8d5b-061a337b0d39 tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:45 user nova-compute[82009]: WARNING nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received unexpected event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with vm_state deleted and task_state None.
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:45 user nova-compute[82009]: WARNING nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received unexpected event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with vm_state deleted and task_state None.
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:45 user nova-compute[82009]: WARNING nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received unexpected event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with vm_state deleted and task_state None.
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Acquiring lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] Lock "2fdbfe12-0376-480d-a63d-7db4a2ac2243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] No waiting events found dispatching network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:45 user nova-compute[82009]: WARNING nova.compute.manager [req-c273c14d-9ddd-4b2c-9887-8d4fe2600181 req-7b4d724a-df62-44e5-af2b-a8a3203a22be service nova] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Received unexpected event network-vif-plugged-8fbca9dd-8f56-4336-be2e-7341f550e2a7 for instance with vm_state deleted and task_state None.
Apr 11 18:18:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:48 user nova-compute[82009]: INFO nova.compute.manager [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Unshelving
Apr 11 18:18:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquired lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG nova.network.neutron [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'info_cache' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:48 user nova-compute[82009]: INFO nova.virt.block_device [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Booting with volume cec3ad28-d4ef-47b1-8fb0-4e979af79136 at /dev/vdc
Apr 11 18:18:48 user nova-compute[82009]: DEBUG os_brick.utils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d4808-6609-4021-a77c-cb4049518ed6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c120f8ac-4ea3-4d6b-9fcc-ef3c74aa296c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c4f6c-cba2-4fcb-9de7-e435c54d8ff5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a5c4a-1554-403f-a4c2-1c2d010d3511]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:18:48 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:18:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48a1e99-eeff-4b46-a49d-31a46b433961]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG os_brick.utils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:18:48 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating existing volume attachment record: 1f2994a2-47d5-4aa6-9eab-f92a7caa1bbf {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.network.neutron [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Releasing lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:49 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance destroyed successfully.
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'resources' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73d8e6ed-57, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:49 user nova-compute[82009]: INFO os_vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57')
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:18:49 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b497bf9-3dcb-4dae-a967-35c8fec3ba44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:18:49 user nova-compute[82009]: No targets found.
Apr 11 18:18:49 user nova-compute[82009]: iSNS:
Apr 11 18:18:49 user nova-compute[82009]: No targets found.
Apr 11 18:18:49 user nova-compute[82009]: STATIC:
Apr 11 18:18:49 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:18:49 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:18:49 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:18:49 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:18:49 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:18:49 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:18:49 user nova-compute[82009]: FIRMWARE:
Apr 11 18:18:49 user nova-compute[82009]: No targets found.
Apr 11 18:18:49 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:18:49 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:18:49 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7241e755-2e0f-40b0-a056-f82c5bfe9dfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5a2e7-9df3-4811-9fac-a0620f6d3cc6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:18:49 user nova-compute[82009]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:18:49 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:18:49 user nova-compute[82009]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:18:49 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6bf09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac19070-e543-4947-9471-dd9f64122e09]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ad1df-ca66-4549-ad28-6ef9a7c861f1]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb294c8-64bc-4f39-831c-e1e05e2d16dd]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2beb755-28fc-46ef-93e5-44f00709ff35]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20e882-0b65-4fa1-9544-2536bd648e94]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaabe1d-a3b5-4c14-9e8f-f2857ecbfe78]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]
Apr 11 18:18:49 user nova-compute[82009]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.
Apr 11 18:18:49 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eea998-4dee-4a20-8535-3886b7478b5c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== disconnect_volume: return (321ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start _get_guest_xml network_info=[{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f014b013-12ba-4133-b4c4-5815ce55d39f', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e7908f28-28c2-4b9a-b804-042f0d186691', 'attached_at': '', 'detached_at': '', 'volume_id': '7fcd6aab-4190-481d-bea1-4aff73c18083', 'serial': '7fcd6aab-4190-481d-bea1-4aff73c18083'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'numa_topology' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:49 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:49 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:18:49 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:18:49 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:18:49 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1f1c8-a0b2-4cdf-82c8-1e56ace17ff9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:18:49 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c12a844-0c6a-48db-878f-6a738576b553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083] added
Apr 11 18:18:49 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a4753e-b24c-455c-9439-d55e0ab76077]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7acfb22-2995-4bcd-b670-b222364086af]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmCruaDR {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmCruaDR" returned: 0 in 0.099s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a866e492-5a05-472f-85a6-dd9429c31f96]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmCruaDR'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada37144-3a9c-45a9-bff0-5dd7ef1847a7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b5b8d-9b2c-4746-bb8b-7b8be9629029]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:18:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:18:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d94ca4-67fb-471d-933e-6cf5d9e6aeb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]
Apr 11 18:18:50 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.
Apr 11 18:18:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f45981-bf01-4237-8b42-e34f731655e2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dea8e0-4c86-44ab-9304-8ea584103a45]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:18:50 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:18:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:18:50 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:18:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2227ed-2f8e-462a-9399-9456e9242de1]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26234353339653234', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234353339653234', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'pci_devices' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:18:51 user nova-compute[82009]:   <uuid>e7908f28-28c2-4b9a-b804-042f0d186691</uuid>
Apr 11 18:18:51 user nova-compute[82009]:   <name>instance-00000011</name>
Apr 11 18:18:51 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:18:51 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:18:51 user nova-compute[82009]:   <metadata>
Apr 11 18:18:51 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:18:51 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:18:51 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeTestJSON-server-977045182</nova:name>
Apr 11 18:18:51 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:18:49</nova:creationTime>
Apr 11 18:18:51 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:18:51 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:18:51 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:18:51 user nova-compute[82009]:       <nova:owner>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:user uuid="b852c50aeb514b7fbe5a9b72e8bbdc14">tempest-AttachVolumeTestJSON-369540173-project-member</nova:user>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:project uuid="d77a56502d9848a3842c938d5adc8c51">tempest-AttachVolumeTestJSON-369540173</nova:project>
Apr 11 18:18:51 user nova-compute[82009]:       </nova:owner>
Apr 11 18:18:51 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:18:51 user nova-compute[82009]:       <nova:ports>
Apr 11 18:18:51 user nova-compute[82009]:         <nova:port uuid="73d8e6ed-570b-444e-a062-22d66314138a">
Apr 11 18:18:51 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:18:51 user nova-compute[82009]:         </nova:port>
Apr 11 18:18:51 user nova-compute[82009]:       </nova:ports>
Apr 11 18:18:51 user nova-compute[82009]:     </nova:instance>
Apr 11 18:18:51 user nova-compute[82009]:   </metadata>
Apr 11 18:18:51 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:18:51 user nova-compute[82009]:     <system>
Apr 11 18:18:51 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:18:51 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:18:51 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:18:51 user nova-compute[82009]:       <entry name="serial">e7908f28-28c2-4b9a-b804-042f0d186691</entry>
Apr 11 18:18:51 user nova-compute[82009]:       <entry name="uuid">e7908f28-28c2-4b9a-b804-042f0d186691</entry>
Apr 11 18:18:51 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:18:51 user nova-compute[82009]:     </system>
Apr 11 18:18:51 user nova-compute[82009]:   </sysinfo>
Apr 11 18:18:51 user nova-compute[82009]:   <os>
Apr 11 18:18:51 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:18:51 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:18:51 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:18:51 user nova-compute[82009]:   </os>
Apr 11 18:18:51 user nova-compute[82009]:   <features>
Apr 11 18:18:51 user nova-compute[82009]:     <acpi/>
Apr 11 18:18:51 user nova-compute[82009]:     <apic/>
Apr 11 18:18:51 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:18:51 user nova-compute[82009]:   </features>
Apr 11 18:18:51 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:18:51 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:18:51 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:18:51 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:18:51 user nova-compute[82009]:   </clock>
Apr 11 18:18:51 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:18:51 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:18:51 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:18:51 user nova-compute[82009]:   </cpu>
Apr 11 18:18:51 user nova-compute[82009]:   <devices>
Apr 11 18:18:51 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:18:51 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:18:51 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk"/>
Apr 11 18:18:51 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:18:51 user nova-compute[82009]:     </disk>
Apr 11 18:18:51 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:18:51 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:18:51 user nova-compute[82009]:       <source dev="/dev/sdb"/>
Apr 11 18:18:51 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:18:51 user nova-compute[82009]:       <serial>7fcd6aab-4190-481d-bea1-4aff73c18083</serial>
Apr 11 18:18:51 user nova-compute[82009]:     </disk>
Apr 11 18:18:51 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:18:51 user nova-compute[82009]:       <mac address="fa:16:3e:8b:69:25"/>
Apr 11 18:18:51 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:18:51 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:18:51 user nova-compute[82009]:       <target dev="tap73d8e6ed-57"/>
Apr 11 18:18:51 user nova-compute[82009]:     </interface>
Apr 11 18:18:51 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:18:51 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/console.log" append="off"/>
Apr 11 18:18:51 user nova-compute[82009]:     </serial>
Apr 11 18:18:51 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:18:51 user nova-compute[82009]:     <video>
Apr 11 18:18:51 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:18:51 user nova-compute[82009]:     </video>
Apr 11 18:18:51 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:18:51 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:18:51 user nova-compute[82009]:     </rng>
Apr 11 18:18:51 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:18:51 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:18:51 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:18:51 user nova-compute[82009]:     </memballoon>
Apr 11 18:18:51 user nova-compute[82009]:   </devices>
Apr 11 18:18:51 user nova-compute[82009]: </domain>
Apr 11 18:18:51 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Cannot resize image /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'migration_context' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG os_vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73d8e6ed-57, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73d8e6ed-57, col_values=(('external_ids', {'iface-id': '73d8e6ed-570b-444e-a062-22d66314138a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:69:25', 'vm-uuid': 'e7908f28-28c2-4b9a-b804-042f0d186691'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:51 user nova-compute[82009]: INFO os_vif [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57')
Apr 11 18:18:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'pci_requests' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'numa_topology' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG nova.compute.manager [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:53 user nova-compute[82009]: WARNING nova.compute.manager [req-6741e761-23ed-4c4e-8d28-b092db0b19a4 req-b0d8fe26-f988-4bc2-9f55-c7debf8df2b6 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state stopped and task_state powering-on.
Apr 11 18:18:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:18:53 user nova-compute[82009]: INFO nova.compute.claims [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Claim successful on node user
Apr 11 18:18:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:54 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:18:54 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:18:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:54 user nova-compute[82009]: INFO nova.network.neutron [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating port f85d33cf-427d-4b1c-ac2a-da35c15cdb90 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'flavor' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:55 user nova-compute[82009]: INFO nova.compute.manager [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attaching volume 314d5532-2e55-4c33-84fc-47a99b78f74a to /dev/vdb
Apr 11 18:18:55 user nova-compute[82009]: DEBUG os_brick.utils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f12b28-0feb-45af-ba26-d82f2097ef08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c598f-865d-4ab0-877a-b8f797fcc1cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a687a-95a8-4c4a-a3b8-58ce4f3e9ca0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[da256cb9-c548-4d1a-a0ad-8c3a048de137]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:18:55 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea08c3-49b9-412c-8434-fb264eb8ae01]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG os_brick.utils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating existing volume attachment record: e3c48d0b-1c9e-4820-995d-0ec4cce79514 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237135.584903, e7908f28-28c2-4b9a-b804-042f0d186691 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:55 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Resumed (Lifecycle Event)
Apr 11 18:18:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance rebooted successfully.
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-aee785dd-26cd-496c-a2d5-f20164dea8e4 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:18:55 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237135.5863495, e7908f28-28c2-4b9a-b804-042f0d186691 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:55 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Started (Lifecycle Event)
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:18:55 user nova-compute[82009]: WARNING nova.compute.manager [req-7020b6d5-d70d-4b14-941f-3a5251fda80e req-f4a1aab0-c0f5-46f2-999c-d0b575e67680 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state active and task_state None.
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:18:56 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Creating image(s)
Apr 11 18:18:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'trusted_certs' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "a4bfea7aae224ff3dc80e01c443b85c2c6503a06" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a4bfea7aae224ff3dc80e01c443b85c2c6503a06" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.part --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.virt.images [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 6404c11d-9a1a-4083-a0cf-5265675d1166 was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.part /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.part /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.converted" returned: 0 in 0.326s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a4bfea7aae224ff3dc80e01c443b85c2c6503a06" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.345s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing instance network info cache due to event network-changed-f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG nova.network.neutron [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Refreshing network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "a4bfea7aae224ff3dc80e01c443b85c2c6503a06" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a4bfea7aae224ff3dc80e01c443b85c2c6503a06" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating instance_info_cache with network_info: [{"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06,backing_fmt=raw /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06,backing_fmt=raw /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk 1073741824" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a4bfea7aae224ff3dc80e01c443b85c2c6503a06" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237123.337662, 2fdbfe12-0376-480d-a63d-7db4a2ac2243 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:18:58 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] VM Stopped (Lifecycle Event)
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 --force-share --output=json" returned: 0 in 0.180s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'migration_context' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:18:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Rebasing disk image.
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-62de3346-432b-48c9-8bda-b9b3c81cc8cf None None] [instance: 2fdbfe12-0376-480d-a63d-7db4a2ac2243] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 -F raw /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.network.neutron [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updated VIF entry in instance network info cache for port f85d33cf-427d-4b1c-ac2a-da35c15cdb90. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.network.neutron [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b23ba891-ae74-49e1-b497-15e36bf18d1b req-bb5a9280-f2c9-43c7-abdc-1e0f481dc684 service nova] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:18:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:18:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:18:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:18:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:18:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:00 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:00 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:00 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d27cd9a-6122-4f05-a6f5-f1d0c0c7a05b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:19:00 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c76df2-4315-4479-8c37-c433ae519c9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a] added
Apr 11 18:19:00 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd3d0d-5503-442d-b4d7-8f74245842de]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-changed-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing instance network info cache due to event network-changed-d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Acquiring lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Acquired lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG nova.network.neutron [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Refreshing network info cache for port d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94235fe-e462-4964-894b-a4a548684ce0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyCaJwWZ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyCaJwWZ" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[62859ac5-a02f-484c-8832-bb43c1a4ea04]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyCaJwWZ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba4b3d-58a5-4564-8df0-e41143688beb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c18a7-6127-4b42-9741-f3e986661adc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: INFO nova.compute.manager [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Terminating instance
Apr 11 18:19:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f661e-3d60-4bea-9d8f-b10aaedea5d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]
Apr 11 18:19:00 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.
Apr 11 18:19:00 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5bf358-a8b2-4f8a-bc46-fea5c8da7f60]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1cbe0e-b86f-43e0-9dc8-20ec4e9a3e7e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:00 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:00 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:00 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.528s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[198a0af1-39ed-4728-9fa1-0e4ec7849ae3]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 -F raw /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk" returned: 0 in 2.474s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Ensure instance console log exists: /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Start _get_guest_xml network_info=[{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c4874c1cf594bc69e3643ce4addcb6ce',container_format='bare',created_at=2023-04-11T18:16:56Z,direct_url=<?>,disk_format='qcow2',id=6404c11d-9a1a-4083-a0cf-5265675d1166,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1005799066-shelved',owner='0ed92c60cf9644b5ba5cefd2e92df3e0',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T18:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1f2994a2-47d5-4aa6-9eab-f92a7caa1bbf', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgpvowSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '582e004b-a2f3-4397-9ccb-d23f5724ebe1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cec3ad28-d4ef-47b1-8fb0-4e979af79136', 'serial': 'cec3ad28-d4ef-47b1-8fb0-4e979af79136'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'flavor' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:19:01 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:01 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c4874c1cf594bc69e3643ce4addcb6ce',container_format='bare',created_at=2023-04-11T18:16:56Z,direct_url=<?>,disk_format='qcow2',id=6404c11d-9a1a-4083-a0cf-5265675d1166,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1005799066-shelved',owner='0ed92c60cf9644b5ba5cefd2e92df3e0',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T18:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'vcpu_model' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgpvowSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:01 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:19:01 user nova-compute[82009]: INFO nova.compute.claims [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Claim successful on node user
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:01 user nova-compute[82009]: INFO nova.compute.manager [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Attaching volume a3861b91-6351-4328-8e27-bbffbd356684 to /dev/vdb
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updated VIF entry in instance network info cache for port d870c097-5a51-464e-94e5-d29336bee09d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [{"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-42861fc4-eebd-4663-bfb4-9c8173de71be req-1d4eaddb-7e57-44a8-9ee4-d09d70afeed9 service nova] Releasing lock "refresh_cache-2fef8f1e-9300-4bd6-8958-4386541a9c0c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Instance destroyed successfully.
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lazy-loading 'resources' on Instance uuid 2fef8f1e-9300-4bd6-8958-4386541a9c0c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1554900069',display_name='tempest-TestShelveInstance-server-1554900069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1554900069',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJoEwkISzTf/Xl7bcqN5WFtK8IzBxrVabbCuw9Mu4MRtB0G1QNlNr8PwZepxAvxrQAcbqFk6TTH2cZjSmdlEbyBSzPwALnwMfNcWaTDuhhOtxF38FYCkmUerlI+JQ1TEg==',key_name='tempest-TestShelveInstance-1371472427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6090bfb65d0c4afeb5ac38c45083799d',ramdisk_id='',reservation_id='r-trhuh3i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-839951281',owner_user_name='tempest-TestShelveInstance-839951281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:17:21Z,user_data=None,user_id='43dc7c5c888247029ff6adedbdb2e938',uuid=2fef8f1e-9300-4bd6-8958-4386541a9c0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converting VIF {"id": "d870c097-5a51-464e-94e5-d29336bee09d", "address": "fa:16:3e:7d:03:34", "network": {"id": "72ea9f23-84b0-4068-a61e-020436d38b6f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2052707157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6090bfb65d0c4afeb5ac38c45083799d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd870c097-5a", "ovs_interfaceid": "d870c097-5a51-464e-94e5-d29336bee09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_vif [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd870c097-5a, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.utils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: INFO os_vif [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:03:34,bridge_name='br-int',has_traffic_filtering=True,id=d870c097-5a51-464e-94e5-d29336bee09d,network=Network(72ea9f23-84b0-4068-a61e-020436d38b6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd870c097-5a')
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kESRZuIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:01 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60908089-a4b6-4b8c-99ae-a8f6dfacf19e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ae431-ba69-4ae7-a841-c8357c3faa00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f181845-248c-4196-b0b3-f8f2ae4ddeaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf2a0b9-c00a-4310-adb8-6c4e2383c5ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:19:01 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d7739-0f42-4e6c-80bc-5e3a1cc5e20d]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.utils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating existing volume attachment record: 8141393a-298f-4c18-a757-5f4dd1118831 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.658s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1661ms) {'type': 'block', 'scsi_wwn': '26563303561346464', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563303561346464', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.726s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:01 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:01 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'flavor' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55c432-3819-4be9-a43c-8daca9d5590b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:19:01 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:19:01 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:19:01 user nova-compute[82009]:   <source dev="/dev/sdc"/>
Apr 11 18:19:01 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:19:01 user nova-compute[82009]:   <serial>314d5532-2e55-4c33-84fc-47a99b78f74a</serial>
Apr 11 18:19:01 user nova-compute[82009]: </disk>
Apr 11 18:19:01 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e245ed-c430-4773-9ec8-d81165b338d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136] added
Apr 11 18:19:01 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b61c067-71b4-4f35-b138-6a59be7a4345]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d948ecb-928b-4418-9f55-e95c82dd121c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgpvowSF {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgpvowSF" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d32b35-4381-435a-9d7b-05ecec391e1a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DgpvowSF'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.935s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[95951ba6-291d-45c6-8e15-ec30d4c84ee9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7daf7-a8d8-43b2-81bd-6b4d88e1950d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:19:02 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae56654c-f08c-410f-a9b7-a97a32e2f058]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260]
Apr 11 18:19:02 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260] successful.
Apr 11 18:19:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da14d3-8647-4773-8a75-647da8d5a4c5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c959af6-d688-437c-8907-5513e556ca21]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.policy [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:02 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.556s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:19:02 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Creating image(s)
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "/opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "/opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "/opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-unplugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Acquiring lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] No waiting events found dispatching network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:02 user nova-compute[82009]: WARNING nova.compute.manager [req-1c2fa25c-ec4c-488d-93b1-01dd48ce14dd req-9c3ea048-5d65-4ae2-8ba1-7739a895d740 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received unexpected event network-vif-plugged-d870c097-5a51-464e-94e5-d29336bee09d for instance with vm_state active and task_state deleting.
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5e0e86-1131-4964-95ca-2b86f3bef1e1]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgpvowSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:fd:e3:b5, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-96b77276-03c7-42a2-aaa2-4bfe77a26dcb tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.487s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk 1073741824" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:19:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Successfully created port: acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Cannot resize image /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.objects.instance [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'migration_context' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Ensure instance console log exists: /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.615s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] <== connect_volume: return (2342ms) {'type': 'block', 'scsi_wwn': '23231653666373730', 'path': '/dev/sde'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231653666373730', 'path': '/dev/sde'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.986s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[500afd88-21db-44d8-8e2b-ae50d8a6cfc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:19:03 user nova-compute[82009]: No targets found.
Apr 11 18:19:03 user nova-compute[82009]: iSNS:
Apr 11 18:19:03 user nova-compute[82009]: No targets found.
Apr 11 18:19:03 user nova-compute[82009]: STATIC:
Apr 11 18:19:03 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142
Apr 11 18:19:03 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:03 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:03 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:19:03 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:03 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:03 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136
Apr 11 18:19:03 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:03 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:03 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:19:03 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:03 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:03 user nova-compute[82009]: FIRMWARE:
Apr 11 18:19:03 user nova-compute[82009]: No targets found.
Apr 11 18:19:03 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:19:03 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:19:03 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1005799066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1005799066',id=18,image_ref='6404c11d-9a1a-4083-a0cf-5265675d1166',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-504297625',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-i8mh72dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member',shelved_at='2023-04-11T18:17:00.425475',shelved_host='user',shelved_image_id='6404c11d-9a1a-4083-a0cf-5265675d1166'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=582e004b-a2f3-4397-9ccb-d23f5724ebe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'pci_devices' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[29670c64-8bce-458c-972b-e1fb2612742e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:19:03 user nova-compute[82009]:   <uuid>582e004b-a2f3-4397-9ccb-d23f5724ebe1</uuid>
Apr 11 18:19:03 user nova-compute[82009]:   <name>instance-00000012</name>
Apr 11 18:19:03 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:19:03 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:19:03 user nova-compute[82009]:   <metadata>
Apr 11 18:19:03 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:19:03 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:19:03 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1005799066</nova:name>
Apr 11 18:19:03 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:19:01</nova:creationTime>
Apr 11 18:19:03 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:19:03 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:19:03 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:19:03 user nova-compute[82009]:       <nova:owner>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:user uuid="b724859b7dcd4fd29f17bbf991e9f6d4">tempest-AttachVolumeShelveTestJSON-93672654-project-member</nova:user>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:project uuid="0ed92c60cf9644b5ba5cefd2e92df3e0">tempest-AttachVolumeShelveTestJSON-93672654</nova:project>
Apr 11 18:19:03 user nova-compute[82009]:       </nova:owner>
Apr 11 18:19:03 user nova-compute[82009]:       <nova:root type="image" uuid="6404c11d-9a1a-4083-a0cf-5265675d1166"/>
Apr 11 18:19:03 user nova-compute[82009]:       <nova:ports>
Apr 11 18:19:03 user nova-compute[82009]:         <nova:port uuid="f85d33cf-427d-4b1c-ac2a-da35c15cdb90">
Apr 11 18:19:03 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 18:19:03 user nova-compute[82009]:         </nova:port>
Apr 11 18:19:03 user nova-compute[82009]:       </nova:ports>
Apr 11 18:19:03 user nova-compute[82009]:     </nova:instance>
Apr 11 18:19:03 user nova-compute[82009]:   </metadata>
Apr 11 18:19:03 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:19:03 user nova-compute[82009]:     <system>
Apr 11 18:19:03 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:19:03 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:19:03 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:19:03 user nova-compute[82009]:       <entry name="serial">582e004b-a2f3-4397-9ccb-d23f5724ebe1</entry>
Apr 11 18:19:03 user nova-compute[82009]:       <entry name="uuid">582e004b-a2f3-4397-9ccb-d23f5724ebe1</entry>
Apr 11 18:19:03 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:19:03 user nova-compute[82009]:     </system>
Apr 11 18:19:03 user nova-compute[82009]:   </sysinfo>
Apr 11 18:19:03 user nova-compute[82009]:   <os>
Apr 11 18:19:03 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:19:03 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:19:03 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:19:03 user nova-compute[82009]:   </os>
Apr 11 18:19:03 user nova-compute[82009]:   <features>
Apr 11 18:19:03 user nova-compute[82009]:     <acpi/>
Apr 11 18:19:03 user nova-compute[82009]:     <apic/>
Apr 11 18:19:03 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:19:03 user nova-compute[82009]:   </features>
Apr 11 18:19:03 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:19:03 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:19:03 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:19:03 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:19:03 user nova-compute[82009]:   </clock>
Apr 11 18:19:03 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:19:03 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:19:03 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:19:03 user nova-compute[82009]:   </cpu>
Apr 11 18:19:03 user nova-compute[82009]:   <devices>
Apr 11 18:19:03 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:19:03 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:19:03 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk"/>
Apr 11 18:19:03 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:19:03 user nova-compute[82009]:     </disk>
Apr 11 18:19:03 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:19:03 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:19:03 user nova-compute[82009]:       <source dev="/dev/sde"/>
Apr 11 18:19:03 user nova-compute[82009]:       <target dev="vdc" bus="virtio"/>
Apr 11 18:19:03 user nova-compute[82009]:       <serial>cec3ad28-d4ef-47b1-8fb0-4e979af79136</serial>
Apr 11 18:19:03 user nova-compute[82009]:     </disk>
Apr 11 18:19:03 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:19:03 user nova-compute[82009]:       <mac address="fa:16:3e:80:b4:71"/>
Apr 11 18:19:03 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:19:03 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:19:03 user nova-compute[82009]:       <target dev="tapf85d33cf-42"/>
Apr 11 18:19:03 user nova-compute[82009]:     </interface>
Apr 11 18:19:03 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:19:03 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/console.log" append="off"/>
Apr 11 18:19:03 user nova-compute[82009]:     </serial>
Apr 11 18:19:03 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:19:03 user nova-compute[82009]:     <video>
Apr 11 18:19:03 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:19:03 user nova-compute[82009]:     </video>
Apr 11 18:19:03 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:19:03 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:19:03 user nova-compute[82009]:     </rng>
Apr 11 18:19:03 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:19:03 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:19:03 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:19:03 user nova-compute[82009]:     </memballoon>
Apr 11 18:19:03 user nova-compute[82009]:   </devices>
Apr 11 18:19:03 user nova-compute[82009]: </domain>
Apr 11 18:19:03 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1005799066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1005799066',id=18,image_ref='6404c11d-9a1a-4083-a0cf-5265675d1166',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-504297625',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-i8mh72dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member',shelved_at='2023-04-11T18:17:00.425475',shelved_host='user',shelved_image_id='6404c11d-9a1a-4083-a0cf-5265675d1166'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=582e004b-a2f3-4397-9ccb-d23f5724ebe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_vif [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85d33cf-42, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf85d33cf-42, col_values=(('external_ids', {'iface-id': 'f85d33cf-427d-4b1c-ac2a-da35c15cdb90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:b4:71', 'vm-uuid': '582e004b-a2f3-4397-9ccb-d23f5724ebe1'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a23ef7-42f6-4290-b038-a65be1de0e07]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:03 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:03 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:03 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:03 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 (non-flash)
Apr 11 18:19:03 user nova-compute[82009]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:03 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:03 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:03 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6cb2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:19:03 user nova-compute[82009]: INFO os_vif [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42')
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[25212631-6794-47f4-8f81-3553dd1ef1e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cddce9-0083-4f82-814e-7ecf08e96dbf]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No VIF found with MAC fa:16:3e:80:b4:71, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f871696b-1f2d-4245-ad40-9b542e178a73]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7820baba-357a-49fe-a3b7-4c1b478ac348]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b895bbe-65d1-451a-89fc-8aafb89e3625]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2876cece-0d64-45aa-abd3-41e99630d61d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260]
Apr 11 18:19:03 user nova-compute[82009]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142, portal: 172.16.0.220,3260] successful.
Apr 11 18:19:03 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc9035-772b-48ee-8fd4-b89cd9319142 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcacb4f5-6b1f-4dfc-9747-dd379cc589a2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] <== disconnect_volume: return (2447ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:19:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Deleting instance files /opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c_del
Apr 11 18:19:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Deletion of /opt/stack/data/nova/instances/2fef8f1e-9300-4bd6-8958-4386541a9c0c_del complete
Apr 11 18:19:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Successfully updated port: acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237147.2972198, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] VM Resumed (Lifecycle Event)
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-changed-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Refreshing instance network info cache due to event network-changed-acc2e042-39c9-42c0-9fbe-405412bba1af. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Acquiring lock "refresh_cache-671f8fb2-8d06-4766-921f-a3ceb83f4bbd" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Acquired lock "refresh_cache-671f8fb2-8d06-4766-921f-a3ceb83f4bbd" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Refreshing network info cache for port acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:07 user nova-compute[82009]: WARNING nova.compute.manager [req-6616b259-83cd-4e09-86ca-98ae3e4eb175 req-a0012faf-1690-4540-b92a-93553b162d69 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:07 user nova-compute[82009]: WARNING nova.compute.manager [req-f830937e-f07d-407b-a325-dc0bacb032dc req-2cc1306e-8474-461e-8284-615aa26c5f3b service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "refresh_cache-671f8fb2-8d06-4766-921f-a3ceb83f4bbd" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFlQadVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:07 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:07 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:07 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.compute.manager [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Took 7.03 seconds to destroy the instance on the hypervisor.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:07 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:07 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7557MB free_disk=26.234844207763672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faec71d-ed09-4d39-9cc8-1954ca0e49bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance spawned successfully.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:19:07 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Stashing vm_state: active {{(pid=82009) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237147.2986615, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] VM Started (Lifecycle Event)
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627149c-3037-40be-8539-87cca9947651]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684] added
Apr 11 18:19:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca68d5-e574-4165-b02b-d760e71ea712]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating resource usage from migration 976d3b21-9221-4043-9daf-d9958a980754
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 7296c02e-f468-45b9-b037-e6cd240dd27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (c90f7e3d-8e75-47f9-93b3-09ecdef87e26): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Migration 976d3b21-9221-4043-9daf-d9958a980754 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.084s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[66984a66-8165-4013-a69a-74ecdcdf44ee]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFlQadVf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFlQadVf" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d2c009-0f82-4a36-a627-dda8c9f77f71]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFlQadVf'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[014dac89-c120-4d99-a6c5-16ab29b649b7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade4e46-69e8-40a8-b530-e68d976d1104]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:07 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:07 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:07 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:07 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0afc0dd5-21a5-49f8-9ba0-cefd544247da tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.480s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaac743-e439-46b3-89a1-d28d6f9a6c0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260]
Apr 11 18:19:07 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260] successful.
Apr 11 18:19:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-24496108-c571-45dd-8caf-ce197c6b9ddc req-78a1b4d3-1f16-4879-bbf7-4ae400539c12 service nova] Releasing lock "refresh_cache-671f8fb2-8d06-4766-921f-a3ceb83f4bbd" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquired lock "refresh_cache-671f8fb2-8d06-4766-921f-a3ceb83f4bbd" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[986160bc-5c9c-4b64-9e4b-997c973a1285]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[278cb0e8-04ec-4909-a88e-9446b38d3b0b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:08 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:08 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:08 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:08 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:08 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:08 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:08 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:08 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd292d1-22a1-41dc-9bec-0a3c922b2578]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Received event network-vif-deleted-d870c097-5a51-464e-94e5-d29336bee09d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:08 user nova-compute[82009]: INFO nova.compute.manager [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Neutron deleted interface d870c097-5a51-464e-94e5-d29336bee09d; detaching it from the instance and deleting it from the info cache
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:08 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Took 0.62 seconds to deallocate network for instance.
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-1426322f-454a-4a45-9b2f-de6e3b4c1322 req-4e8ddb66-0b97-4c6b-ba9d-f8c02c6e4cd2 service nova] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Detach interface failed, port_id=d870c097-5a51-464e-94e5-d29336bee09d, reason: Instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.576s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_requests' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:19:08 user nova-compute[82009]: INFO nova.compute.claims [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Claim successful on node user
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_devices' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Updating instance_info_cache with network_info: [{"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:08 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating resource usage from migration 976d3b21-9221-4043-9daf-d9958a980754
Apr 11 18:19:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Releasing lock "refresh_cache-671f8fb2-8d06-4766-921f-a3ceb83f4bbd" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Instance network_info: |[{"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Start _get_guest_xml network_info=[{"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:08 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:08 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1793009425',display_name='tempest-VolumesSnapshotTestJSON-instance-1793009425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1793009425',id=25,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde6ebc41bed44f1a04e23e62cd9ac0d',ramdisk_id='',reservation_id='r-k75wi5ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-251988417',owner_user_name='tempest-VolumesSnapshotTestJSON-251988417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:19:02Z,user_data=None,user_id='5fdf10ea561448f689cdd2d052080168',uuid=671f8fb2-8d06-4766-921f-a3ceb83f4bbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converting VIF {"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'pci_devices' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:19:08 user nova-compute[82009]:   <uuid>671f8fb2-8d06-4766-921f-a3ceb83f4bbd</uuid>
Apr 11 18:19:08 user nova-compute[82009]:   <name>instance-00000019</name>
Apr 11 18:19:08 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:19:08 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:19:08 user nova-compute[82009]:   <metadata>
Apr 11 18:19:08 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:19:08 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:19:08 user nova-compute[82009]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1793009425</nova:name>
Apr 11 18:19:08 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:19:08</nova:creationTime>
Apr 11 18:19:08 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:19:08 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:19:08 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:19:08 user nova-compute[82009]:       <nova:owner>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:user uuid="5fdf10ea561448f689cdd2d052080168">tempest-VolumesSnapshotTestJSON-251988417-project-member</nova:user>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:project uuid="fde6ebc41bed44f1a04e23e62cd9ac0d">tempest-VolumesSnapshotTestJSON-251988417</nova:project>
Apr 11 18:19:08 user nova-compute[82009]:       </nova:owner>
Apr 11 18:19:08 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:19:08 user nova-compute[82009]:       <nova:ports>
Apr 11 18:19:08 user nova-compute[82009]:         <nova:port uuid="acc2e042-39c9-42c0-9fbe-405412bba1af">
Apr 11 18:19:08 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:19:08 user nova-compute[82009]:         </nova:port>
Apr 11 18:19:08 user nova-compute[82009]:       </nova:ports>
Apr 11 18:19:08 user nova-compute[82009]:     </nova:instance>
Apr 11 18:19:08 user nova-compute[82009]:   </metadata>
Apr 11 18:19:08 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:19:08 user nova-compute[82009]:     <system>
Apr 11 18:19:08 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:19:08 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:19:08 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:19:08 user nova-compute[82009]:       <entry name="serial">671f8fb2-8d06-4766-921f-a3ceb83f4bbd</entry>
Apr 11 18:19:08 user nova-compute[82009]:       <entry name="uuid">671f8fb2-8d06-4766-921f-a3ceb83f4bbd</entry>
Apr 11 18:19:08 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:19:08 user nova-compute[82009]:     </system>
Apr 11 18:19:08 user nova-compute[82009]:   </sysinfo>
Apr 11 18:19:08 user nova-compute[82009]:   <os>
Apr 11 18:19:08 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:19:08 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:19:08 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:19:08 user nova-compute[82009]:   </os>
Apr 11 18:19:08 user nova-compute[82009]:   <features>
Apr 11 18:19:08 user nova-compute[82009]:     <acpi/>
Apr 11 18:19:08 user nova-compute[82009]:     <apic/>
Apr 11 18:19:08 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:19:08 user nova-compute[82009]:   </features>
Apr 11 18:19:08 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:19:08 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:19:08 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:19:08 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:19:08 user nova-compute[82009]:   </clock>
Apr 11 18:19:08 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:19:08 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:19:08 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:19:08 user nova-compute[82009]:   </cpu>
Apr 11 18:19:08 user nova-compute[82009]:   <devices>
Apr 11 18:19:08 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:19:08 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:19:08 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk"/>
Apr 11 18:19:08 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:19:08 user nova-compute[82009]:     </disk>
Apr 11 18:19:08 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:19:08 user nova-compute[82009]:       <mac address="fa:16:3e:16:fe:cf"/>
Apr 11 18:19:08 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:19:08 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:19:08 user nova-compute[82009]:       <target dev="tapacc2e042-39"/>
Apr 11 18:19:08 user nova-compute[82009]:     </interface>
Apr 11 18:19:08 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:19:08 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/console.log" append="off"/>
Apr 11 18:19:08 user nova-compute[82009]:     </serial>
Apr 11 18:19:08 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:19:08 user nova-compute[82009]:     <video>
Apr 11 18:19:08 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:19:08 user nova-compute[82009]:     </video>
Apr 11 18:19:08 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:19:08 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:19:08 user nova-compute[82009]:     </rng>
Apr 11 18:19:08 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:19:08 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:19:08 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:19:08 user nova-compute[82009]:     </memballoon>
Apr 11 18:19:08 user nova-compute[82009]:   </devices>
Apr 11 18:19:08 user nova-compute[82009]: </domain>
Apr 11 18:19:08 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1793009425',display_name='tempest-VolumesSnapshotTestJSON-instance-1793009425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1793009425',id=25,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde6ebc41bed44f1a04e23e62cd9ac0d',ramdisk_id='',reservation_id='r-k75wi5ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-251988417',owner_user_name='tempest-VolumesSnapshotTestJSON-251988417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:19:02Z,user_data=None,user_id='5fdf10ea561448f689cdd2d052080168',uuid=671f8fb2-8d06-4766-921f-a3ceb83f4bbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converting VIF {"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG os_vif [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc2e042-39, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacc2e042-39, col_values=(('external_ids', {'iface-id': 'acc2e042-39c9-42c0-9fbe-405412bba1af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:fe:cf', 'vm-uuid': '671f8fb2-8d06-4766-921f-a3ceb83f4bbd'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:08 user nova-compute[82009]: INFO os_vif [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39')
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No VIF found with MAC fa:16:3e:16:fe:cf, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:19:09 user nova-compute[82009]: INFO nova.compute.manager [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Took 0.87 seconds to detach 1 volumes for instance.
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Deleting volume: c2cc9035-772b-48ee-8fd4-b89cd9319142 {{(pid=82009) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.723s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:09 user nova-compute[82009]: INFO nova.compute.manager [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Migrating
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFlQadVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.534s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== connect_volume: return (1536ms) {'type': 'block', 'scsi_wwn': '23065633866353931', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065633866353931', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:19:09 user nova-compute[82009]: INFO nova.compute.rpcapi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'flavor' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:19:09 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:19:09 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:19:09 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:19:09 user nova-compute[82009]:   <serial>a3861b91-6351-4328-8e27-bbffbd356684</serial>
Apr 11 18:19:09 user nova-compute[82009]: </disk>
Apr 11 18:19:09 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:09 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Deleted allocations for instance 2fef8f1e-9300-4bd6-8958-4386541a9c0c
Apr 11 18:19:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Starting migrate_disk_and_power_off {{(pid=82009) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 18:19:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7348abb6-6392-4760-8e9a-a12897acae4f tempest-TestShelveInstance-839951281 tempest-TestShelveInstance-839951281-project-member] Lock "2fef8f1e-9300-4bd6-8958-4386541a9c0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.427s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:10 user nova-compute[82009]: WARNING nova.compute.manager [req-afce7188-46e8-479d-99e2-520d5b93ded2 req-6afa7af4-e1b0-4db0-92b4-8efa7684803e service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state resize_migrating.
Apr 11 18:19:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] No VIF found with MAC fa:16:3e:33:a4:b3, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74f978da-d9fc-4edf-bf1c-5c8071414979 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.160s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance destroyed successfully.
Apr 11 18:19:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cc8035-8d, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: INFO os_vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:19:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:11 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a9d71f-3233-4275-b536-1fb99c54e5c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:19:11 user nova-compute[82009]: No targets found.
Apr 11 18:19:11 user nova-compute[82009]: iSNS:
Apr 11 18:19:11 user nova-compute[82009]: No targets found.
Apr 11 18:19:11 user nova-compute[82009]: STATIC:
Apr 11 18:19:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:19:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136
Apr 11 18:19:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:19:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:19:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:19:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:19:11 user nova-compute[82009]: FIRMWARE:
Apr 11 18:19:11 user nova-compute[82009]: No targets found.
Apr 11 18:19:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:19:11 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:19:11 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1e4b4-7ac4-4a87-82b4-f3d0c24e1829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[65094962-8c11-4099-a7de-27c693b3b1cd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:11 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:11 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:11 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:11 user nova-compute[82009]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:11 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:11 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6bf25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9a3af-59b1-4bfc-80ca-7ecc416a9f7b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6665c77e-e0ae-4daf-b623-87cc048a7470]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82bf1a-c47b-4f0f-a49d-26ed52a8f329]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1555fd03-9cd4-446e-b2b4-3bacf2e8ae25]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e7d510-a6a1-4616-b6c1-f3ab6e0d37ee]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35852eff-955a-41ff-93db-f68d73bf7db8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]
Apr 11 18:19:11 user nova-compute[82009]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.
Apr 11 18:19:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3395ed15-a47b-4358-bcde-5dd8b4b21f7b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (384ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_resize/disk /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "cp -r /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_resize/disk /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk" returned: 0 in 0.258s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_resize/disk.info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "cp -r /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_resize/disk.info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk.info" returned: 0 in 0.034s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:12 user nova-compute[82009]: WARNING nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state resize_migrating.
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] No waiting events found dispatching network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:12 user nova-compute[82009]: WARNING nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received unexpected event network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af for instance with vm_state building and task_state spawning.
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] No waiting events found dispatching network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:12 user nova-compute[82009]: WARNING nova.compute.manager [req-dea0a0aa-2405-4ec3-a72f-c843fdb8573d req-a3220e26-af5d-4026-a0b2-43e102afb5ec service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received unexpected event network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af for instance with vm_state building and task_state spawning.
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237153.1798155, 671f8fb2-8d06-4766-921f-a3ceb83f4bbd => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] VM Resumed (Lifecycle Event)
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Instance spawned successfully.
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237153.1841724, 671f8fb2-8d06-4766-921f-a3ceb83f4bbd => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] VM Started (Lifecycle Event)
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing instance network info cache due to event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Port 98cc8035-8d3e-47cf-9758-c7172120ac70 binding to destination host user is already ACTIVE {{(pid=82009) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Took 10.94 seconds to spawn the instance on the hypervisor.
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:13 user nova-compute[82009]: INFO nova.compute.manager [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Took 12.36 seconds to build instance.
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-164e2418-6dd8-4816-a66d-e1314d747d59 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.467s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updated VIF entry in instance network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-38b1b24f-3381-4f80-9b65-21670b1fa9bb req-4132fd46-bd8c-444c-826e-e16a3ee8f83e service nova] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG os_brick.utils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbf37a3-b188-4093-88eb-cb627375d8c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeecd563-92da-42b8-9389-ed8fde88571c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c386af0a-ca06-436b-a535-47537e54d953]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5bf06-83bd-411a-8cf0-cbf6a31ca0d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:19:14 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:19:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e82fe0-6bbb-4f7d-b0eb-78b28d170a6c]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:19:14 user nova-compute[82009]: DEBUG os_brick.utils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing instance network info cache due to event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:15 user nova-compute[82009]: INFO nova.compute.manager [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Rebooting instance
Apr 11 18:19:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updated VIF entry in instance network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f7fffd08-a01a-4ff5-aa2d-34c219567592 req-fc4b556e-1338-4ac2-ac5c-1e77559c9c4f service nova] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237141.3767862, 2fef8f1e-9300-4bd6-8958-4386541a9c0c => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:16 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] VM Stopped (Lifecycle Event)
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-bebbea31-3c8f-40f2-90b4-c20fea52f34b None None] [instance: 2fef8f1e-9300-4bd6-8958-4386541a9c0c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Starting finish_migration {{(pid=82009) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:19:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Creating image(s)
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:19 user nova-compute[82009]: WARNING nova.compute.manager [req-a252679e-5b82-4413-abfa-dcff7777c880 req-7a811042-64e2-4caa-9a89-5e33d85146cd service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state active and task_state reboot_started.
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Cannot resize image /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Ensure instance console log exists: /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start _get_guest_xml network_info=[{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '26b5af86-4066-4dcd-a57f-7b4a4bba17f7', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1adc9f1d-cc32-446e-9ffc-5fada2383164', 'attached_at': '2023-04-11T18:19:19.000000', 'detached_at': '', 'volume_id': '314d5532-2e55-4c33-84fc-47a99b78f74a', 'serial': '314d5532-2e55-4c33-84fc-47a99b78f74a'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:19:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:19:19 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:19 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:19:19 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118b554-4d81-451f-84f5-159d7baec097]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:19:19 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[add1ff48-1afc-43f5-8e7c-ede49772f331]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a] added
Apr 11 18:19:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970ba0b-419d-4856-91a1-de6d9a1391ec]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[33485816-33d2-4dad-8b18-e7d993a22aaa]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyCaJwWZ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyCaJwWZ" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90d86f-b88d-49f4-852b-30249f1b20cd]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyCaJwWZ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc141d5-04e9-43f3-9381-6d99dc57480b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c0f425-ec78-4ecc-9319-1cc9b48c593a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:19 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:19 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:19 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:19 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:19 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance shutdown successfully.
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9cd8ba-9bad-4e16-a65d-78fd0ef67207]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]
Apr 11 18:19:20 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.
Apr 11 18:19:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb34043b-6e3d-4944-ba74-232900969c45]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc14ce0c-7dc0-418d-82fd-62fd0b35bf5d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:20 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:20 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:20 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:19:20 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:19:20 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:19:20 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:19:20 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcccd9d-4a00-4238-8df5-ed2b9ec3ddb3]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:19:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26563303561346464', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563303561346464', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:19:21 user nova-compute[82009]:   <uuid>1adc9f1d-cc32-446e-9ffc-5fada2383164</uuid>
Apr 11 18:19:21 user nova-compute[82009]:   <name>instance-00000006</name>
Apr 11 18:19:21 user nova-compute[82009]:   <memory>196608</memory>
Apr 11 18:19:21 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:19:21 user nova-compute[82009]:   <metadata>
Apr 11 18:19:21 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:19:21 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:19:21 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-731201773</nova:name>
Apr 11 18:19:21 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:19:19</nova:creationTime>
Apr 11 18:19:21 user nova-compute[82009]:       <nova:flavor name="m1.micro">
Apr 11 18:19:21 user nova-compute[82009]:         <nova:memory>192</nova:memory>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:19:21 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:19:21 user nova-compute[82009]:       <nova:owner>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:19:21 user nova-compute[82009]:       </nova:owner>
Apr 11 18:19:21 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:19:21 user nova-compute[82009]:       <nova:ports>
Apr 11 18:19:21 user nova-compute[82009]:         <nova:port uuid="98cc8035-8d3e-47cf-9758-c7172120ac70">
Apr 11 18:19:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:19:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:19:21 user nova-compute[82009]:       </nova:ports>
Apr 11 18:19:21 user nova-compute[82009]:     </nova:instance>
Apr 11 18:19:21 user nova-compute[82009]:   </metadata>
Apr 11 18:19:21 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:19:21 user nova-compute[82009]:     <system>
Apr 11 18:19:21 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:19:21 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:19:21 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:19:21 user nova-compute[82009]:       <entry name="serial">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:19:21 user nova-compute[82009]:       <entry name="uuid">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:19:21 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:19:21 user nova-compute[82009]:     </system>
Apr 11 18:19:21 user nova-compute[82009]:   </sysinfo>
Apr 11 18:19:21 user nova-compute[82009]:   <os>
Apr 11 18:19:21 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:19:21 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:19:21 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:19:21 user nova-compute[82009]:   </os>
Apr 11 18:19:21 user nova-compute[82009]:   <features>
Apr 11 18:19:21 user nova-compute[82009]:     <acpi/>
Apr 11 18:19:21 user nova-compute[82009]:     <apic/>
Apr 11 18:19:21 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:19:21 user nova-compute[82009]:   </features>
Apr 11 18:19:21 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:19:21 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:19:21 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:19:21 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:19:21 user nova-compute[82009]:   </clock>
Apr 11 18:19:21 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:19:21 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:19:21 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:19:21 user nova-compute[82009]:   </cpu>
Apr 11 18:19:21 user nova-compute[82009]:   <devices>
Apr 11 18:19:21 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:19:21 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:19:21 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk"/>
Apr 11 18:19:21 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:19:21 user nova-compute[82009]:     </disk>
Apr 11 18:19:21 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:19:21 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:19:21 user nova-compute[82009]:       <source dev="/dev/sdc"/>
Apr 11 18:19:21 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:19:21 user nova-compute[82009]:       <serial>314d5532-2e55-4c33-84fc-47a99b78f74a</serial>
Apr 11 18:19:21 user nova-compute[82009]:     </disk>
Apr 11 18:19:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:19:21 user nova-compute[82009]:       <mac address="fa:16:3e:fd:e3:b5"/>
Apr 11 18:19:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:19:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:19:21 user nova-compute[82009]:       <target dev="tap98cc8035-8d"/>
Apr 11 18:19:21 user nova-compute[82009]:     </interface>
Apr 11 18:19:21 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:19:21 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log" append="off"/>
Apr 11 18:19:21 user nova-compute[82009]:     </serial>
Apr 11 18:19:21 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:19:21 user nova-compute[82009]:     <video>
Apr 11 18:19:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:19:21 user nova-compute[82009]:     </video>
Apr 11 18:19:21 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:19:21 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:19:21 user nova-compute[82009]:     </rng>
Apr 11 18:19:21 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:19:21 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:19:21 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:19:21 user nova-compute[82009]:     </memballoon>
Apr 11 18:19:21 user nova-compute[82009]:   </devices>
Apr 11 18:19:21 user nova-compute[82009]: </domain>
Apr 11 18:19:21 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:fd:e3:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG os_vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cc8035-8d, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98cc8035-8d, col_values=(('external_ids', {'iface-id': '98cc8035-8d3e-47cf-9758-c7172120ac70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e3:b5', 'vm-uuid': '1adc9f1d-cc32-446e-9ffc-5fada2383164'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: INFO os_vif [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:fd:e3:b5, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:21 user nova-compute[82009]: WARNING nova.compute.manager [req-61350d52-5bef-488c-b6ab-8820c8efc1b0 req-db37e8d0-a82c-4166-acd0-73950a1be853 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state active and task_state reboot_started.
Apr 11 18:19:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:23 user nova-compute[82009]: WARNING nova.compute.manager [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state active and task_state reboot_started.
Apr 11 18:19:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:23 user nova-compute[82009]: WARNING nova.compute.manager [req-251ea83b-e998-4e14-ab8c-bbcf8e2dcce7 req-a5549731-1369-4415-a544-9507a565c6ba service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state active and task_state reboot_started.
Apr 11 18:19:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 7296c02e-f468-45b9-b037-e6cd240dd27d due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237165.4896653, 7296c02e-f468-45b9-b037-e6cd240dd27d => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] VM Resumed (Lifecycle Event)
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance running successfully.
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance soft rebooted successfully.
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237165.489763, 7296c02e-f468-45b9-b037-e6cd240dd27d => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] VM Started (Lifecycle Event)
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f23514b9-d011-400c-bbab-0c863c45572e tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.662s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:25 user nova-compute[82009]: WARNING nova.compute.manager [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state resize_finish.
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:25 user nova-compute[82009]: WARNING nova.compute.manager [req-e6a1ecec-7c2b-4adc-8618-1ab1458144dd req-642959d5-cae0-4bbf-a53e-cff5bed71969 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state resize_finish.
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 1adc9f1d-cc32-446e-9ffc-5fada2383164 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237165.9374552, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Resumed (Lifecycle Event)
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:19:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance running successfully.
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Failed to set time: agent not configured {{(pid=82009) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-e44650d4-a8e1-4c35-85fb-3bc3714a1b1f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] finish_migration finished successfully. {{(pid=82009) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 18:19:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 18:19:26 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237165.9376392, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Started (Lifecycle Event)
Apr 11 18:19:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:19:26 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 18:19:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:37 user nova-compute[82009]: INFO nova.compute.manager [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Terminating instance
Apr 11 18:19:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-vif-unplugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] No waiting events found dispatching network-vif-unplugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-ff963f51-837d-44f5-a4ec-d69e64289230 req-fbb676cc-353b-4781-b5e9-aa543dbbb09c service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-vif-unplugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:19:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Instance destroyed successfully.
Apr 11 18:19:38 user nova-compute[82009]: DEBUG nova.objects.instance [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lazy-loading 'resources' on Instance uuid db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1603498422',display_name='tempest-VolumesAdminNegativeTest-server-1603498422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1603498422',id=15,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2PgzNFmwBsFUNuQ95xhwKc3ab85OukYflSWY9oEAX8fbv+TSaubOQPFW2shpSVHS5iAGWk+Kf+qNt/RNc14rmRY/3EDWnt360T6Gp6M9r075izLzf0oeIHzGVgNGQ+SA==',key_name='tempest-keypair-581234075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad8dd512b7424fbe996ecbd18d11471e',ramdisk_id='',reservation_id='r-3553quxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-298923704',owner_user_name='tempest-VolumesAdminNegativeTest-298923704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:14:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20726e00e3743168e32eafe43318e20',uuid=db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converting VIF {"id": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "address": "fa:16:3e:f8:c4:74", "network": {"id": "bff39075-a0de-4117-8653-a12c13830d54", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1098026050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad8dd512b7424fbe996ecbd18d11471e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8110c1e3-0e", "ovs_interfaceid": "8110c1e3-0ed5-46e0-8f26-6c6d00460693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG os_vif [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8110c1e3-0e, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:38 user nova-compute[82009]: INFO os_vif [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:c4:74,bridge_name='br-int',has_traffic_filtering=True,id=8110c1e3-0ed5-46e0-8f26-6c6d00460693,network=Network(bff39075-a0de-4117-8653-a12c13830d54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8110c1e3-0e')
Apr 11 18:19:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Deleting instance files /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7_del
Apr 11 18:19:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Deletion of /opt/stack/data/nova/instances/db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7_del complete
Apr 11 18:19:38 user nova-compute[82009]: INFO nova.compute.manager [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 18:19:38 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:19:38 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:39 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Took 1.09 seconds to deallocate network for instance.
Apr 11 18:19:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-vif-deleted-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:39 user nova-compute[82009]: INFO nova.compute.manager [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Neutron deleted interface 8110c1e3-0ed5-46e0-8f26-6c6d00460693; detaching it from the instance and deleting it from the info cache
Apr 11 18:19:39 user nova-compute[82009]: DEBUG nova.network.neutron [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-f6fe1d07-3c36-4da5-9484-d9d195d27530 req-355cd47f-26ff-4116-a268-b98539ca63ad service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Detach interface failed, port_id=8110c1e3-0ed5-46e0-8f26-6c6d00460693, reason: Instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received event network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Acquiring lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] No waiting events found dispatching network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:19:39 user nova-compute[82009]: WARNING nova.compute.manager [req-ced56dda-66bd-467e-baf6-3f20dd09fef8 req-fca86482-9d1e-4edd-8616-b1f6c0cead79 service nova] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Received unexpected event network-vif-plugged-8110c1e3-0ed5-46e0-8f26-6c6d00460693 for instance with vm_state deleted and task_state None.
Apr 11 18:19:40 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:19:40 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:19:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:40 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Deleted allocations for instance db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7
Apr 11 18:19:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-196d4d42-bfdf-4e77-b320-32b10825698a tempest-VolumesAdminNegativeTest-298923704 tempest-VolumesAdminNegativeTest-298923704-project-member] Lock "db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:53 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237178.208234, db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:19:53 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] VM Stopped (Lifecycle Event)
Apr 11 18:19:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d8aada1b-26eb-4623-bd13-40688c32709a None None] [instance: db680a76-d9ec-4a4a-a7cf-14d1a7b3e1b7] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:19:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:19:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:19:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:19:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:19:59 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:20:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:20:03 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:03 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7379MB free_disk=26.272899627685547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Applying migration context for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 as it has an incoming, in-progress migration 976d3b21-9221-4043-9daf-d9958a980754. Migration status is finished {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 18:20:03 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating resource usage from migration 976d3b21-9221-4043-9daf-d9958a980754
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 7296c02e-f468-45b9-b037-e6cd240dd27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Migration 976d3b21-9221-4043-9daf-d9958a980754 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:20:03 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:20:04 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:20:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:20:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:20:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:20:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-changed-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Refreshing instance network info cache due to event network-changed-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Acquiring lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Acquired lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Refreshing network info cache for port 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'flavor' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:08 user nova-compute[82009]: INFO nova.compute.manager [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Attaching volume a0f35c4f-1fb8-4465-a94e-0119cf53bda2 to /dev/vdb
Apr 11 18:20:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updated VIF entry in instance network info cache for port 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updating instance_info_cache with network_info: [{"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6e6ec3b1-ff49-4fb4-9da4-b10417e8a670 req-c98e9174-50b4-4f30-8231-06bba1a63b74 service nova] Releasing lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca63cb3-e5cf-4347-ae33-0ce69828f214]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ef8fe6-8658-4698-8a01-0d0018e3833a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.061s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[56188466-8a30-4750-8eb6-8b38faf44340]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5823cd4-2ee6-4533-a182-bf2a4bd4b096]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:09 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:20:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[795e0b71-8d3d-49e6-a893-71969e56832f]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG os_brick.utils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:09 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updating existing volume attachment record: 9f780492-48d4-42fd-9baf-a0fc97be0a1d {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:20:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjXBiJNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:13 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:13 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:13 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cacbdb9-fee5-4a57-ba81-875bc5bcc323]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:20:13 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb620976-3f34-4baf-a769-dae253a96d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2] added
Apr 11 18:20:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f2a7c-aec0-4ce2-babd-7800be3b6c38]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c745467f-8a37-4f59-944c-489c0ad69e8b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HjXBiJNa {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HjXBiJNa" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c2becb-bd67-47d6-ab0d-6d07729a91d5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HjXBiJNa'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062574d-60a9-4a6e-a2e4-cdc18d37c458]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[71534deb-34b4-43fb-8623-e468b6fc5704]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c75bc-fb55-4af8-ab58-a134a2ce7e3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260]
Apr 11 18:20:13 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71dc3d-11d6-4763-bc8c-6c33ddd7e0b8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1327537e-5945-4326-a972-a5a5b520965a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:13 user nova-compute[82009]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 (non-flash)
Apr 11 18:20:13 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217c25b-dcbb-4404-96cc-315a273bfff8]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:20:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjXBiJNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:20:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26265303333373564', 'path': '/dev/sdf'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265303333373564', 'path': '/dev/sdf'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:20:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'flavor' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:20:14 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:14 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:20:14 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:14 user nova-compute[82009]:   <serial>a0f35c4f-1fb8-4465-a94e-0119cf53bda2</serial>
Apr 11 18:20:14 user nova-compute[82009]: </disk>
Apr 11 18:20:14 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:20:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] No VIF found with MAC fa:16:3e:0d:7a:a6, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:20:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7662b0b1-3e48-491c-9348-0b64ec289ce7 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.547s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:16 user nova-compute[82009]: INFO nova.compute.manager [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Detaching volume a0f35c4f-1fb8-4465-a94e-0119cf53bda2
Apr 11 18:20:16 user nova-compute[82009]: INFO nova.virt.block_device [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Attempting to driver detach volume a0f35c4f-1fb8-4465-a94e-0119cf53bda2 from mountpoint /dev/vdb
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Attempting to detach device vdb from instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:20:16 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:16 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:20:16 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:16 user nova-compute[82009]:   <serial>a0f35c4f-1fb8-4465-a94e-0119cf53bda2</serial>
Apr 11 18:20:16 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:20:16 user nova-compute[82009]: </disk>
Apr 11 18:20:16 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:20:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully detached device vdb from instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 from the persistent domain config.
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:20:16 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:16 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:20:16 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:16 user nova-compute[82009]:   <serial>a0f35c4f-1fb8-4465-a94e-0119cf53bda2</serial>
Apr 11 18:20:16 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:20:16 user nova-compute[82009]: </disk>
Apr 11 18:20:16 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237216.6439266, e7b91dda-27c6-4bcd-99ec-c818c5c93373 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:20:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully detached device vdb from instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 from the live domain config.
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HjXBiJNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:16 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de6c2d-b769-4adc-843e-255a40b1b1ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:20:16 user nova-compute[82009]: No targets found.
Apr 11 18:20:16 user nova-compute[82009]: iSNS:
Apr 11 18:20:16 user nova-compute[82009]: No targets found.
Apr 11 18:20:16 user nova-compute[82009]: STATIC:
Apr 11 18:20:16 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:20:16 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:16 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:16 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2
Apr 11 18:20:16 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:16 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:16 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136
Apr 11 18:20:16 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:16 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:16 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:20:16 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:16 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:16 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:20:16 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:16 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:16 user nova-compute[82009]: FIRMWARE:
Apr 11 18:20:16 user nova-compute[82009]: No targets found.
Apr 11 18:20:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:20:16 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:20:16 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[613278b4-5719-47cc-b369-7c5a218bc9e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e94f7-d709-4313-8d16-e8406b9862aa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:16 user nova-compute[82009]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 (non-flash)
Apr 11 18:20:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c02b5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2'): ({'sdf'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Removing single pathed devices sdf {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba409c-a030-46ac-a0c6-e233eedbc491]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c046e-e11d-4fd1-93b6-9c97d78ce07d]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Flushing IO for device /dev/sdf {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[11047a3c-f146-472f-a4ae-2d62d733c1d1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e4d4a-03bd-4579-9bcd-2232a0a63d37]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8a461-525a-4ffb-94d5-76a037d81d3b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf0192-ad99-417b-b44d-77ecbcf33f98]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260]
Apr 11 18:20:16 user nova-compute[82009]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f35c4f-1fb8-4465-a94e-0119cf53bda2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fdc0a-e6db-455b-af76-d78273704537]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] <== disconnect_volume: return (322ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:20:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:17 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'flavor' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3ecc03a8-25d8-4499-ae9e-ccc3db8d6c2d tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "bfd52279-f440-48cb-9c97-8133c7322482" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:18 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:20:18 user nova-compute[82009]: INFO nova.compute.claims [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Claim successful on node user
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:20:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:20:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:20:19 user nova-compute[82009]: INFO nova.virt.block_device [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Booting with volume snapshot 403746c3-b913-4165-851f-a2bf3adaa8c6 at /dev/vda
Apr 11 18:20:19 user nova-compute[82009]: DEBUG nova.policy [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:20:20 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Successfully created port: 8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Successfully updated port: 8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "refresh_cache-bfd52279-f440-48cb-9c97-8133c7322482" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquired lock "refresh_cache-bfd52279-f440-48cb-9c97-8133c7322482" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-changed-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Refreshing instance network info cache due to event network-changed-8db65a44-6cb3-4c5e-b180-49709126b545. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Acquiring lock "refresh_cache-bfd52279-f440-48cb-9c97-8133c7322482" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Updating instance_info_cache with network_info: [{"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Releasing lock "refresh_cache-bfd52279-f440-48cb-9c97-8133c7322482" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Instance network_info: |[{"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Acquired lock "refresh_cache-bfd52279-f440-48cb-9c97-8133c7322482" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Refreshing network info cache for port 8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:20:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Updated VIF entry in instance network info cache for port 8db65a44-6cb3-4c5e-b180-49709126b545. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:20:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Updating instance_info_cache with network_info: [{"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d27169ae-a900-4e74-892c-f4ef0e6a673a req-894ac717-6710-4855-9e82-c3a434bf4773 service nova] Releasing lock "refresh_cache-bfd52279-f440-48cb-9c97-8133c7322482" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing instance network info cache due to event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG nova.objects.instance [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:23 user nova-compute[82009]: INFO nova.compute.manager [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Attaching volume ab2addce-fd37-48c2-be0e-131ebef2ce29 to /dev/vdb
Apr 11 18:20:23 user nova-compute[82009]: DEBUG os_brick.utils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a042654-fcbb-41ef-a4b4-da9e4b242e1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af8b4e-9067-4f65-9900-2c62300e388b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG nova.network.neutron [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updated VIF entry in instance network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG nova.network.neutron [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1cb6bca-a6ac-47e7-aed8-c818f9fb37da req-081fd0ec-5de3-4ac9-b365-ab654902033e service nova] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809225d-39f4-4afb-a90c-6095cf7efcd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b584db72-66b4-4357-ad3c-bcd25f9308ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:24 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:20:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb51387-fd7b-47ab-a6cf-5bbe5a9b5e0f]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG os_brick.utils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:24 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating existing volume attachment record: b7b82b5b-0043-4419-8f62-3b1714e48d4c {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG os_brick.utils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569024e-3d54-4905-9014-47644b598c5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f1dec-738f-44b1-8c85-8b0034668908]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8a1da-2c05-4746-8a96-d71055a4ef34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd1f816-6e38-4224-ae86-c52e557c026c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:25 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:20:25 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[80096d8f-b007-4cdb-9eb9-ff9c69f40547]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG os_brick.utils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:25 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Updating existing volume attachment record: ce093fb5-9623-48e1-b808-9ef334bd8417 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:20:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sOdZFqVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:28 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:28 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:28 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34f4df0-e4a5-4ac8-8c7c-c19cc4ffc7b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:20:28 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3bb585-c515-498a-9ca3-d9685cd8987f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29] added
Apr 11 18:20:28 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91a957-1485-434c-ab12-fad918a60bee]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beacc3f-c8b4-45bc-8bf4-3aa98bab8f77]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sOdZFqVh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sOdZFqVh" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae0ca4b-aed3-4a4a-9935-8f26ed8bdacb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sOdZFqVh'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b67c3f6-66ab-4cfc-800f-7e43d86ab055]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f980cc-4fa1-4106-8417-a7250540ff9f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:28 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:28 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297abb6-381a-40f3-a92b-682542b6bd36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260]
Apr 11 18:20:28 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:28 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8252ac1c-3c30-48f8-a0d8-9953b43a21a1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ddc89d-9e31-4d50-9180-a59eb1b9696d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:28 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:28 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab7b3f3-01f5-4f73-93ed-37727c4f78b5]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:28 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:20:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Creating image(s)
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Ensure instance console log exists: /opt/stack/data/nova/instances/bfd52279-f440-48cb-9c97-8133c7322482/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Start _get_guest_xml network_info=[{"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ce093fb5-9623-48e1-b808-9ef334bd8417', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEYCuxWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfd52279-f440-48cb-9c97-8133c7322482', 'attached_at': '', 'detached_at': '', 'volume_id': '7ee215f7-2a29-4b25-b6bc-73e4d67670a1', 'serial': '7ee215f7-2a29-4b25-b6bc-73e4d67670a1'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:20:29 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:29 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEYCuxWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:29 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sOdZFqVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23637343665363961', 'path': '/dev/sdf'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637343665363961', 'path': '/dev/sdf'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:29 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:29 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.objects.instance [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5f794-8b5f-45ff-b80f-5d3d415f338e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:20:29 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:20:29 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:29 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:20:29 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:29 user nova-compute[82009]:   <serial>ab2addce-fd37-48c2-be0e-131ebef2ce29</serial>
Apr 11 18:20:29 user nova-compute[82009]: </disk>
Apr 11 18:20:29 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[080decff-ddff-467c-b8ee-b7f0bbceaa59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1] added
Apr 11 18:20:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb26af-e519-43d2-86e3-05756ee37521]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[227215c9-c313-40b7-af8c-4d979d227d5d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEYCuxWc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VEYCuxWc" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2dc036-c4f1-49cb-9bf5-e45d682bc4f4]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VEYCuxWc'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54da430-c96b-4735-bb95-2cba22c8a909]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[efda500d-fb6f-4d7e-ab5d-7fec6caf0715]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc5cd1-7b28-42a0-ad5f-c79fc2fd7bcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260]
Apr 11 18:20:29 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a79ce-e5e3-47f6-a5d8-aad3b24888bf]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c07894-68e2-4fff-86ca-c41786fdd682]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[236586ed-7bd9-444f-a6a4-a9adaab6e3b2]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:20:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEYCuxWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:b5:43:66, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-769caef0-fac9-48b6-a040-f2f91017d208 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.294s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23039623433626130', 'path': '/dev/sdg'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039623433626130', 'path': '/dev/sdg'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:20:30 user nova-compute[82009]: INFO nova.compute.manager [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Rescuing
Apr 11 18:20:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720236868',display_name='tempest-TestVolumeBootPattern-server-720236868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-720236868',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-di0d09x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:20:19Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=bfd52279-f440-48cb-9c97-8133c7322482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'pci_devices' on Instance uuid bfd52279-f440-48cb-9c97-8133c7322482 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:20:30 user nova-compute[82009]:   <uuid>bfd52279-f440-48cb-9c97-8133c7322482</uuid>
Apr 11 18:20:30 user nova-compute[82009]:   <name>instance-0000001a</name>
Apr 11 18:20:30 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:20:30 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:20:30 user nova-compute[82009]:   <metadata>
Apr 11 18:20:30 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:20:30 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:20:30 user nova-compute[82009]:       <nova:name>tempest-TestVolumeBootPattern-server-720236868</nova:name>
Apr 11 18:20:30 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:20:29</nova:creationTime>
Apr 11 18:20:30 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:20:30 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:20:30 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:20:30 user nova-compute[82009]:       <nova:owner>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:user uuid="4c8825bcd5894c999412499de320dc00">tempest-TestVolumeBootPattern-1768143130-project-member</nova:user>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:project uuid="e4f6857b777f4207b93d8c28aa39054b">tempest-TestVolumeBootPattern-1768143130</nova:project>
Apr 11 18:20:30 user nova-compute[82009]:       </nova:owner>
Apr 11 18:20:30 user nova-compute[82009]:       <nova:ports>
Apr 11 18:20:30 user nova-compute[82009]:         <nova:port uuid="8db65a44-6cb3-4c5e-b180-49709126b545">
Apr 11 18:20:30 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:20:30 user nova-compute[82009]:         </nova:port>
Apr 11 18:20:30 user nova-compute[82009]:       </nova:ports>
Apr 11 18:20:30 user nova-compute[82009]:     </nova:instance>
Apr 11 18:20:30 user nova-compute[82009]:   </metadata>
Apr 11 18:20:30 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:20:30 user nova-compute[82009]:     <system>
Apr 11 18:20:30 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:20:30 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:20:30 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:20:30 user nova-compute[82009]:       <entry name="serial">bfd52279-f440-48cb-9c97-8133c7322482</entry>
Apr 11 18:20:30 user nova-compute[82009]:       <entry name="uuid">bfd52279-f440-48cb-9c97-8133c7322482</entry>
Apr 11 18:20:30 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:20:30 user nova-compute[82009]:     </system>
Apr 11 18:20:30 user nova-compute[82009]:   </sysinfo>
Apr 11 18:20:30 user nova-compute[82009]:   <os>
Apr 11 18:20:30 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:20:30 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:20:30 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:20:30 user nova-compute[82009]:   </os>
Apr 11 18:20:30 user nova-compute[82009]:   <features>
Apr 11 18:20:30 user nova-compute[82009]:     <acpi/>
Apr 11 18:20:30 user nova-compute[82009]:     <apic/>
Apr 11 18:20:30 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:20:30 user nova-compute[82009]:   </features>
Apr 11 18:20:30 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:20:30 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:20:30 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:20:30 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:20:30 user nova-compute[82009]:   </clock>
Apr 11 18:20:30 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:20:30 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:20:30 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:20:30 user nova-compute[82009]:   </cpu>
Apr 11 18:20:30 user nova-compute[82009]:   <devices>
Apr 11 18:20:30 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:20:30 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:30 user nova-compute[82009]:       <source dev="/dev/sdg"/>
Apr 11 18:20:30 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:20:30 user nova-compute[82009]:       <serial>7ee215f7-2a29-4b25-b6bc-73e4d67670a1</serial>
Apr 11 18:20:30 user nova-compute[82009]:     </disk>
Apr 11 18:20:30 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:20:30 user nova-compute[82009]:       <mac address="fa:16:3e:32:70:f3"/>
Apr 11 18:20:30 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:20:30 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:20:30 user nova-compute[82009]:       <target dev="tap8db65a44-6c"/>
Apr 11 18:20:30 user nova-compute[82009]:     </interface>
Apr 11 18:20:30 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:20:30 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/bfd52279-f440-48cb-9c97-8133c7322482/console.log" append="off"/>
Apr 11 18:20:30 user nova-compute[82009]:     </serial>
Apr 11 18:20:30 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:20:30 user nova-compute[82009]:     <video>
Apr 11 18:20:30 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:20:30 user nova-compute[82009]:     </video>
Apr 11 18:20:30 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:20:30 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:20:30 user nova-compute[82009]:     </rng>
Apr 11 18:20:30 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:20:30 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:20:30 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:20:30 user nova-compute[82009]:     </memballoon>
Apr 11 18:20:30 user nova-compute[82009]:   </devices>
Apr 11 18:20:30 user nova-compute[82009]: </domain>
Apr 11 18:20:30 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720236868',display_name='tempest-TestVolumeBootPattern-server-720236868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-720236868',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-di0d09x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:20:19Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=bfd52279-f440-48cb-9c97-8133c7322482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG os_vif [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8db65a44-6c, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8db65a44-6c, col_values=(('external_ids', {'iface-id': '8db65a44-6cb3-4c5e-b180-49709126b545', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:70:f3', 'vm-uuid': 'bfd52279-f440-48cb-9c97-8133c7322482'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:30 user nova-compute[82009]: INFO os_vif [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c')
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No VIF found with MAC fa:16:3e:32:70:f3, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:31 user nova-compute[82009]: WARNING nova.compute.manager [req-691140eb-5dc1-4b40-83f9-cb51a1c1155f req-951ca193-6704-4cb2-8f9b-f9544d3dd43a service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state active and task_state rescuing.
Apr 11 18:20:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance destroyed successfully.
Apr 11 18:20:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Attempting rescue
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82009) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:20:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Creating image(s)
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'migration_context' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Start _get_guest_xml network_info=[{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:b5:43:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'resources' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'numa_topology' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:32 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:32 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2027322626',display_name='tempest-ServerRescueNegativeTestJSON-server-2027322626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2027322626',id=24,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFIK5aPskfsOVBBGyw4yEbsLtMQvwJFTLOan+Twhh4tjr/C3BYu6u/4BceyXCRAua8zDa2ccvRw2H6FAdWFmjwazVukCovMZ6BukRUwqQ+pfLxuRzbwDkNupsMXFG9o8Q==',key_name='tempest-keypair-1641901033',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:18:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-u5jbgqkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=c5a2e113-75f7-47ac-bdf9-458793a62061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:b5:43:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "vif_mac": "fa:16:3e:b5:43:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'pci_devices' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:20:32 user nova-compute[82009]:   <uuid>c5a2e113-75f7-47ac-bdf9-458793a62061</uuid>
Apr 11 18:20:32 user nova-compute[82009]:   <name>instance-00000018</name>
Apr 11 18:20:32 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:20:32 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:20:32 user nova-compute[82009]:   <metadata>
Apr 11 18:20:32 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:20:32 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:20:32 user nova-compute[82009]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2027322626</nova:name>
Apr 11 18:20:32 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:20:32</nova:creationTime>
Apr 11 18:20:32 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:20:32 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:20:32 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:20:32 user nova-compute[82009]:       <nova:owner>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:user uuid="908e0b5a1ce14f5cb636eda79ac77f7b">tempest-ServerRescueNegativeTestJSON-223229619-project-member</nova:user>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:project uuid="c10b5a531bbc41d680d137a766a8b2d9">tempest-ServerRescueNegativeTestJSON-223229619</nova:project>
Apr 11 18:20:32 user nova-compute[82009]:       </nova:owner>
Apr 11 18:20:32 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:20:32 user nova-compute[82009]:       <nova:ports>
Apr 11 18:20:32 user nova-compute[82009]:         <nova:port uuid="2de8f180-0b9b-405b-abcd-f44d2c15a437">
Apr 11 18:20:32 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:20:32 user nova-compute[82009]:         </nova:port>
Apr 11 18:20:32 user nova-compute[82009]:       </nova:ports>
Apr 11 18:20:32 user nova-compute[82009]:     </nova:instance>
Apr 11 18:20:32 user nova-compute[82009]:   </metadata>
Apr 11 18:20:32 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:20:32 user nova-compute[82009]:     <system>
Apr 11 18:20:32 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:20:32 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:20:32 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:20:32 user nova-compute[82009]:       <entry name="serial">c5a2e113-75f7-47ac-bdf9-458793a62061</entry>
Apr 11 18:20:32 user nova-compute[82009]:       <entry name="uuid">c5a2e113-75f7-47ac-bdf9-458793a62061</entry>
Apr 11 18:20:32 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:20:32 user nova-compute[82009]:     </system>
Apr 11 18:20:32 user nova-compute[82009]:   </sysinfo>
Apr 11 18:20:32 user nova-compute[82009]:   <os>
Apr 11 18:20:32 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:20:32 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:20:32 user nova-compute[82009]:   </os>
Apr 11 18:20:32 user nova-compute[82009]:   <features>
Apr 11 18:20:32 user nova-compute[82009]:     <acpi/>
Apr 11 18:20:32 user nova-compute[82009]:     <apic/>
Apr 11 18:20:32 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:20:32 user nova-compute[82009]:   </features>
Apr 11 18:20:32 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:20:32 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:20:32 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:20:32 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:20:32 user nova-compute[82009]:   </clock>
Apr 11 18:20:32 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:20:32 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:20:32 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:20:32 user nova-compute[82009]:   </cpu>
Apr 11 18:20:32 user nova-compute[82009]:   <devices>
Apr 11 18:20:32 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:20:32 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:20:32 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue"/>
Apr 11 18:20:32 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:20:32 user nova-compute[82009]:     </disk>
Apr 11 18:20:32 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:20:32 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:20:32 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk"/>
Apr 11 18:20:32 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:20:32 user nova-compute[82009]:     </disk>
Apr 11 18:20:32 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:20:32 user nova-compute[82009]:       <mac address="fa:16:3e:b5:43:66"/>
Apr 11 18:20:32 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:20:32 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:20:32 user nova-compute[82009]:       <target dev="tap2de8f180-0b"/>
Apr 11 18:20:32 user nova-compute[82009]:     </interface>
Apr 11 18:20:32 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:20:32 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/console.log" append="off"/>
Apr 11 18:20:32 user nova-compute[82009]:     </serial>
Apr 11 18:20:32 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:20:32 user nova-compute[82009]:     <video>
Apr 11 18:20:32 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:20:32 user nova-compute[82009]:     </video>
Apr 11 18:20:32 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:20:32 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:20:32 user nova-compute[82009]:     </rng>
Apr 11 18:20:32 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:20:32 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:20:32 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:20:32 user nova-compute[82009]:     </memballoon>
Apr 11 18:20:32 user nova-compute[82009]:   </devices>
Apr 11 18:20:32 user nova-compute[82009]: </domain>
Apr 11 18:20:32 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:20:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance destroyed successfully.
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] No waiting events found dispatching network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:32 user nova-compute[82009]: WARNING nova.compute.manager [req-bb519078-658e-4147-ae63-b0ec7f22d096 req-6ac89456-7f57-4fff-8c2b-6f5a3f02b20d service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received unexpected event network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 for instance with vm_state building and task_state spawning.
Apr 11 18:20:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] No VIF found with MAC fa:16:3e:b5:43:66, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:33 user nova-compute[82009]: WARNING nova.compute.manager [req-943c7462-0117-4c1b-ae89-4769adb90825 req-aad4ccee-1042-4efe-852b-e18861658bf4 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state active and task_state rescuing.
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237234.8146381, bfd52279-f440-48cb-9c97-8133c7322482 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] VM Resumed (Lifecycle Event)
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:20:34 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Instance spawned successfully.
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237234.8161197, bfd52279-f440-48cb-9c97-8133c7322482 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] VM Started (Lifecycle Event)
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:34 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:20:34 user nova-compute[82009]: INFO nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 11 18:20:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] No waiting events found dispatching network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:35 user nova-compute[82009]: WARNING nova.compute.manager [req-9cff5891-ff5c-4b7b-a9ab-fb95f593b9e5 req-b7acda57-fa00-485b-be53-c6bca2f127e7 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received unexpected event network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 for instance with vm_state building and task_state spawning.
Apr 11 18:20:35 user nova-compute[82009]: INFO nova.compute.manager [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Took 16.31 seconds to build instance.
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd58c662-52ef-4c52-aa6a-22ae3760de3c tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "bfd52279-f440-48cb-9c97-8133c7322482" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.421s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:35 user nova-compute[82009]: WARNING nova.compute.manager [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state active and task_state rescuing.
Apr 11 18:20:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:35 user nova-compute[82009]: WARNING nova.compute.manager [req-4aa63043-d6db-41e0-9aea-e4d7c7800b22 req-66496df6-e6f5-44e3-a80b-b18651ae1a70 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state active and task_state rescuing.
Apr 11 18:20:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for c5a2e113-75f7-47ac-bdf9-458793a62061 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237236.7436607, c5a2e113-75f7-47ac-bdf9-458793a62061 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:36 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Resumed (Lifecycle Event)
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7077e6d9-8e07-4aba-bc1b-577c51735493 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:36 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237236.7459638, c5a2e113-75f7-47ac-bdf9-458793a62061 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:36 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Started (Lifecycle Event)
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:39 user nova-compute[82009]: INFO nova.compute.manager [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Detaching volume cec3ad28-d4ef-47b1-8fb0-4e979af79136
Apr 11 18:20:39 user nova-compute[82009]: INFO nova.virt.block_device [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Attempting to driver detach volume cec3ad28-d4ef-47b1-8fb0-4e979af79136 from mountpoint /dev/vdc
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Attempting to detach device vdc from instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:20:39 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:39 user nova-compute[82009]:   <source dev="/dev/sde"/>
Apr 11 18:20:39 user nova-compute[82009]:   <target dev="vdc" bus="virtio"/>
Apr 11 18:20:39 user nova-compute[82009]:   <serial>cec3ad28-d4ef-47b1-8fb0-4e979af79136</serial>
Apr 11 18:20:39 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:20:39 user nova-compute[82009]: </disk>
Apr 11 18:20:39 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:20:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully detached device vdc from instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 from the persistent domain config.
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:20:39 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:39 user nova-compute[82009]:   <source dev="/dev/sde"/>
Apr 11 18:20:39 user nova-compute[82009]:   <target dev="vdc" bus="virtio"/>
Apr 11 18:20:39 user nova-compute[82009]:   <serial>cec3ad28-d4ef-47b1-8fb0-4e979af79136</serial>
Apr 11 18:20:39 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:20:39 user nova-compute[82009]: </disk>
Apr 11 18:20:39 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237239.7158182, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:20:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully detached device vdc from instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 from the live domain config.
Apr 11 18:20:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgpvowSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:39 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad480c-1265-43b4-9773-d5eaf00c75d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:20:39 user nova-compute[82009]: No targets found.
Apr 11 18:20:39 user nova-compute[82009]: iSNS:
Apr 11 18:20:39 user nova-compute[82009]: No targets found.
Apr 11 18:20:39 user nova-compute[82009]: STATIC:
Apr 11 18:20:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:20:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:20:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136
Apr 11 18:20:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:20:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:20:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:20:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:39 user nova-compute[82009]: FIRMWARE:
Apr 11 18:20:39 user nova-compute[82009]: No targets found.
Apr 11 18:20:39 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:20:39 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:20:39 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa5b77-bfb8-44e2-9a63-c64da3ba210d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d088f7c-6f93-45b2-895d-b25b3e827c10]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:39 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c02b7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136'): ({'sde'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Removing single pathed devices sde {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb6f34b-f7f0-47cd-9b34-163bb0487a96]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f748ce-729d-4676-b9b7-17f3a6addd35]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flushing IO for device /dev/sde {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d8407-d70a-4e11-969a-e9553e3cd70a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd07c92-9703-4eac-b63f-673351d1d7aa]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242e4b7-b32e-4bbb-a24b-c523345502b9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:40 user nova-compute[82009]: INFO nova.compute.manager [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Detaching volume 7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c59d8-1033-4765-bdc6-831670c4743c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260]
Apr 11 18:20:40 user nova-compute[82009]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: INFO nova.virt.block_device [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Attempting to driver detach volume 7fcd6aab-4190-481d-bea1-4aff73c18083 from mountpoint /dev/vdb
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Attempting to detach device vdb from instance e7908f28-28c2-4b9a-b804-042f0d186691 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:20:40 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:40 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:20:40 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:40 user nova-compute[82009]:   <serial>7fcd6aab-4190-481d-bea1-4aff73c18083</serial>
Apr 11 18:20:40 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:20:40 user nova-compute[82009]: </disk>
Apr 11 18:20:40 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:20:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully detached device vdb from instance e7908f28-28c2-4b9a-b804-042f0d186691 from the persistent domain config.
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7908f28-28c2-4b9a-b804-042f0d186691 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:20:40 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:40 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:20:40 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:40 user nova-compute[82009]:   <serial>7fcd6aab-4190-481d-bea1-4aff73c18083</serial>
Apr 11 18:20:40 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 18:20:40 user nova-compute[82009]: </disk>
Apr 11 18:20:40 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec3ad28-d4ef-47b1-8fb0-4e979af79136 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ee3dbd-8bdd-4e95-9aa1-02db55249de1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] <== disconnect_volume: return (376ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237240.6225474, e7908f28-28c2-4b9a-b804-042f0d186691 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:20:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully detached device vdb from instance e7908f28-28c2-4b9a-b804-042f0d186691 from the live domain config.
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmCruaDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:40 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99f445-84d7-41d0-9c2a-8bbb94c5bf9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:20:40 user nova-compute[82009]: No targets found.
Apr 11 18:20:40 user nova-compute[82009]: iSNS:
Apr 11 18:20:40 user nova-compute[82009]: No targets found.
Apr 11 18:20:40 user nova-compute[82009]: STATIC:
Apr 11 18:20:40 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:20:40 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:40 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:40 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:20:40 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:40 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:40 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083
Apr 11 18:20:40 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:40 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:40 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:20:40 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:40 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:40 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:20:40 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:40 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:40 user nova-compute[82009]: FIRMWARE:
Apr 11 18:20:40 user nova-compute[82009]: No targets found.
Apr 11 18:20:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:20:40 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:20:40 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1201201c-45f7-4f16-8138-0a940319a8c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10babc-90af-4160-bb17-fdecacffd66f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e150fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c7e6e6-a92f-4e1e-b8c8-1f0f68c68034]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ffa5e-0e06-4af4-afce-8f598df39d22]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d3ea7-4058-4410-ac49-1253bc8750e2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b88e1a-a809-42ba-b279-6026ee35febc]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae281598-ab73-4269-83c1-7b4575a4619d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61487cc-a086-4d61-a0c6-4e10ebbcb01a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260]
Apr 11 18:20:40 user nova-compute[82009]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fcd6aab-4190-481d-bea1-4aff73c18083 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5ac8b-28f9-405e-8b61-0fadb10b9ebe]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== disconnect_volume: return (341ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:20:41 user nova-compute[82009]: DEBUG nova.objects.instance [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'flavor' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-303f10ef-c4cb-4f06-b485-04a7cbcb0597 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.098s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:41 user nova-compute[82009]: DEBUG nova.objects.instance [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-618f2d73-8b83-4ee1-8ed0-385e25ac5308 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82009) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:42 user nova-compute[82009]: WARNING nova.compute.manager [req-913fa2e4-a261-4cc2-93f6-278670a6edf4 req-0aa059f3-8422-465a-b9ec-fe7158a3e7f7 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state active and task_state powering-off.
Apr 11 18:20:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance destroyed successfully.
Apr 11 18:20:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a21cd26d-42a0-43a0-a9d1-cdd0afb7f539 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.945s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:44 user nova-compute[82009]: WARNING nova.compute.manager [req-d3a452e4-da22-4e83-be40-e15c85af2f52 req-48ba8f6c-5814-4c46-a195-a617d580ddaf service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state stopped and task_state None.
Apr 11 18:20:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:20:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:45 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:20:45 user nova-compute[82009]: INFO nova.compute.claims [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Claim successful on node user
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:20:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:20:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Creating image(s)
Apr 11 18:20:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.policy [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.167s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk 1073741824" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Cannot resize image /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.objects.instance [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'migration_context' on Instance uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Ensure instance console log exists: /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:47 user nova-compute[82009]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Successfully created port: d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Successfully updated port: d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-changed-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Refreshing instance network info cache due to event network-changed-d2ce54aa-8057-41b6-98ca-988a0fd0491c. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Acquiring lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.network.neutron [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Instance network_info: |[{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Acquired lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.network.neutron [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Refreshing network info cache for port d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Start _get_guest_xml network_info=[{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:20:48 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:48 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:20:48 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690899682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-690899682',id=27,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-fzuhuicy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:20:47Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=a0d74109-f1ce-4361-a037-d23d348f8d3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'pci_devices' on Instance uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:20:49 user nova-compute[82009]:   <uuid>a0d74109-f1ce-4361-a037-d23d348f8d3d</uuid>
Apr 11 18:20:49 user nova-compute[82009]:   <name>instance-0000001b</name>
Apr 11 18:20:49 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:20:49 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:20:49 user nova-compute[82009]:   <metadata>
Apr 11 18:20:49 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:20:49 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:20:49 user nova-compute[82009]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-690899682</nova:name>
Apr 11 18:20:49 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:20:48</nova:creationTime>
Apr 11 18:20:49 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:20:49 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:20:49 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:20:49 user nova-compute[82009]:       <nova:owner>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:user uuid="fde784625fda4447afc0b8e9bd0983a3">tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member</nova:user>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:project uuid="62a254c432f54e1b8735e40af7063506">tempest-ServerBootFromVolumeStableRescueTest-1689319261</nova:project>
Apr 11 18:20:49 user nova-compute[82009]:       </nova:owner>
Apr 11 18:20:49 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:20:49 user nova-compute[82009]:       <nova:ports>
Apr 11 18:20:49 user nova-compute[82009]:         <nova:port uuid="d2ce54aa-8057-41b6-98ca-988a0fd0491c">
Apr 11 18:20:49 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 18:20:49 user nova-compute[82009]:         </nova:port>
Apr 11 18:20:49 user nova-compute[82009]:       </nova:ports>
Apr 11 18:20:49 user nova-compute[82009]:     </nova:instance>
Apr 11 18:20:49 user nova-compute[82009]:   </metadata>
Apr 11 18:20:49 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:20:49 user nova-compute[82009]:     <system>
Apr 11 18:20:49 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:20:49 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:20:49 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:20:49 user nova-compute[82009]:       <entry name="serial">a0d74109-f1ce-4361-a037-d23d348f8d3d</entry>
Apr 11 18:20:49 user nova-compute[82009]:       <entry name="uuid">a0d74109-f1ce-4361-a037-d23d348f8d3d</entry>
Apr 11 18:20:49 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:20:49 user nova-compute[82009]:     </system>
Apr 11 18:20:49 user nova-compute[82009]:   </sysinfo>
Apr 11 18:20:49 user nova-compute[82009]:   <os>
Apr 11 18:20:49 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:20:49 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:20:49 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:20:49 user nova-compute[82009]:   </os>
Apr 11 18:20:49 user nova-compute[82009]:   <features>
Apr 11 18:20:49 user nova-compute[82009]:     <acpi/>
Apr 11 18:20:49 user nova-compute[82009]:     <apic/>
Apr 11 18:20:49 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:20:49 user nova-compute[82009]:   </features>
Apr 11 18:20:49 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:20:49 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:20:49 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:20:49 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:20:49 user nova-compute[82009]:   </clock>
Apr 11 18:20:49 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:20:49 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:20:49 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:20:49 user nova-compute[82009]:   </cpu>
Apr 11 18:20:49 user nova-compute[82009]:   <devices>
Apr 11 18:20:49 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:20:49 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:20:49 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk"/>
Apr 11 18:20:49 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:20:49 user nova-compute[82009]:     </disk>
Apr 11 18:20:49 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:20:49 user nova-compute[82009]:       <mac address="fa:16:3e:74:d0:f2"/>
Apr 11 18:20:49 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:20:49 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:20:49 user nova-compute[82009]:       <target dev="tapd2ce54aa-80"/>
Apr 11 18:20:49 user nova-compute[82009]:     </interface>
Apr 11 18:20:49 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:20:49 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/console.log" append="off"/>
Apr 11 18:20:49 user nova-compute[82009]:     </serial>
Apr 11 18:20:49 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:20:49 user nova-compute[82009]:     <video>
Apr 11 18:20:49 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:20:49 user nova-compute[82009]:     </video>
Apr 11 18:20:49 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:20:49 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:20:49 user nova-compute[82009]:     </rng>
Apr 11 18:20:49 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:20:49 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:20:49 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:20:49 user nova-compute[82009]:     </memballoon>
Apr 11 18:20:49 user nova-compute[82009]:   </devices>
Apr 11 18:20:49 user nova-compute[82009]: </domain>
Apr 11 18:20:49 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690899682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-690899682',id=27,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-fzuhuicy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:20:47Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=a0d74109-f1ce-4361-a037-d23d348f8d3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG os_vif [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2ce54aa-80, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2ce54aa-80, col_values=(('external_ids', {'iface-id': 'd2ce54aa-8057-41b6-98ca-988a0fd0491c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:d0:f2', 'vm-uuid': 'a0d74109-f1ce-4361-a037-d23d348f8d3d'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:49 user nova-compute[82009]: INFO os_vif [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80')
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No VIF found with MAC fa:16:3e:74:d0:f2, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updated VIF entry in instance network info cache for port d2ce54aa-8057-41b6-98ca-988a0fd0491c. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-efa4a3cc-6441-4fe7-8cc5-8cc519f38a22 req-206b10d8-3639-42ca-86e2-32f40b6981e4 service nova] Releasing lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] No waiting events found dispatching network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:50 user nova-compute[82009]: WARNING nova.compute.manager [req-51a49a06-99c6-4099-8561-000c1adc9c83 req-90175a67-c5cd-4c63-8738-c35f5bb9d2c0 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received unexpected event network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance with vm_state building and task_state spawning.
Apr 11 18:20:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:50 user nova-compute[82009]: DEBUG nova.objects.instance [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'flavor' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Ignoring supplied device name: /dev/vdb
Apr 11 18:20:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:51 user nova-compute[82009]: INFO nova.compute.manager [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Attaching volume a5c165e2-cf22-4292-a456-43dde9aacda5 to /dev/vdb
Apr 11 18:20:51 user nova-compute[82009]: DEBUG os_brick.utils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc5c4f-c7f6-439b-a448-613248975951]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f296a29f-8b7d-4097-8710-08f56637d1b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3f2266-cf62-4beb-af4b-7b70e7d6ea69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e0704-6158-4f7e-848e-036252303a65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:51 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:20:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b45358-6b5a-465c-8111-4fef084a2924]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG os_brick.utils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:51 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Updating existing volume attachment record: 83a268cb-fde9-4014-b45f-3ddbff56597c {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237252.6661885, a0d74109-f1ce-4361-a037-d23d348f8d3d => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] VM Resumed (Lifecycle Event)
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Instance spawned successfully.
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237252.6682508, a0d74109-f1ce-4361-a037-d23d348f8d3d => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] VM Started (Lifecycle Event)
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Took 5.88 seconds to spawn the instance on the hypervisor.
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] No waiting events found dispatching network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:52 user nova-compute[82009]: WARNING nova.compute.manager [req-06e29998-19be-4835-b49c-73204c218016 req-bc3d88e7-0943-42ad-ae1e-5d70d6c8df53 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received unexpected event network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance with vm_state building and task_state spawning.
Apr 11 18:20:52 user nova-compute[82009]: INFO nova.compute.manager [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Took 6.92 seconds to build instance.
Apr 11 18:20:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-014e9dbb-83f6-4806-82b5-8f83223eb75f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.049s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Port 98cc8035-8d3e-47cf-9758-c7172120ac70 binding to destination host user is already ACTIVE {{(pid=82009) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Creating tmpfile /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/tmpowwy21ft to verify with other compute node that the instance is on the same shared storage. {{(pid=82009) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:55 user nova-compute[82009]: WARNING nova.compute.manager [req-a6ec06ec-1bab-41a1-a56d-3f1a270b5a8b req-2d5d5261-81d2-4525-8375-8a145c8d4912 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state resized and task_state resize_reverting.
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfMqEnpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:55 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[05124b74-1cbe-445d-80c0-95e651949ddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:20:55 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[599e2728-c4e6-4aec-9b5d-ea6eff059318]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5] added
Apr 11 18:20:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[880526be-ed60-454d-8eef-2c455ae03fb3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b1065b-47c8-4a6c-8350-216b4bf123e2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfMqEnpZ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfMqEnpZ" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d331e36-a590-43cf-a7ca-25ae3a241cd2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfMqEnpZ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d72720-f39e-4edf-8b26-ebfdf07939f8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance destroyed successfully.
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2077ab0-eb6c-4ef6-a677-bdf997fc7c62]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cc8035-8d, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:55 user nova-compute[82009]: INFO os_vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376e7de-fb35-4eed-9f5d-9c6a433cb8cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260]
Apr 11 18:20:55 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad380ad-becb-4ceb-8ac3-f4d3e2c21840]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee127d-0301-4f6d-936f-c86b28e9dc51]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:20:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b7fe9-62d8-4534-aef3-436398e3594f]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:20:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfMqEnpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23933363539313531', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933363539313531', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.149s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'flavor' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad0683-4771-4fe7-8d7e-082ef151153f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:20:57 user nova-compute[82009]: No targets found.
Apr 11 18:20:57 user nova-compute[82009]: iSNS:
Apr 11 18:20:57 user nova-compute[82009]: No targets found.
Apr 11 18:20:57 user nova-compute[82009]: STATIC:
Apr 11 18:20:57 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:20:57 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:57 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:57 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:20:57 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:57 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:57 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5
Apr 11 18:20:57 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:57 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:57 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:20:57 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:57 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:57 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:20:57 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:20:57 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:20:57 user nova-compute[82009]: FIRMWARE:
Apr 11 18:20:57 user nova-compute[82009]: No targets found.
Apr 11 18:20:57 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:20:57 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:20:57 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:20:57 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:20:57 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:20:57 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:20:57 user nova-compute[82009]:   <serial>a5c165e2-cf22-4292-a456-43dde9aacda5</serial>
Apr 11 18:20:57 user nova-compute[82009]: </disk>
Apr 11 18:20:57 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49fda2-a946-4037-8faf-ca713d30d372]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e5bd80-95ef-4519-ae98-f1c52a7394e0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:20:57 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e03f6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.071s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f16cd9c-33a4-48f9-8473-d38a19fe297f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb929cc-3738-4a8e-b516-f2e33f9c8eab]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f475c76d-45bb-44c5-91f3-a58a604c9bd0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e80b9a-908b-48bc-90df-e0fd9bb6da7f]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fec5fd2-e4e3-4a72-9214-5f34cb6329d0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5259345b-4a48-4d4b-a54c-63b9af22792b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]
Apr 11 18:20:57 user nova-compute[82009]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.
Apr 11 18:20:57 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b4d3b-e036-498f-ad65-ea68ff72d20e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (1524ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:20:57 user nova-compute[82009]: WARNING nova.compute.manager [req-d1ab1afa-f95e-4d4e-9cbe-c484170e6420 req-cd7e7876-0562-4311-a3dd-02d3ddd26685 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state resized and task_state resize_reverting.
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No VIF found with MAC fa:16:3e:16:fe:cf, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-511186dc-eb94-4225-b563-0b9869908089 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.600s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'migration_context' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237243.3026161, e7908f28-28c2-4b9a-b804-042f0d186691 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:20:58 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Stopped (Lifecycle Event)
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b7910d2d-3184-498f-9844-4a8c21bf3e98 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b7910d2d-3184-498f-9844-4a8c21bf3e98 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.495s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:58 user nova-compute[82009]: INFO nova.compute.manager [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Swapping old allocation on dict_keys(['c90f7e3d-8e75-47f9-93b3-09ecdef87e26']) held by migration 976d3b21-9221-4043-9daf-d9958a980754 for instance
Apr 11 18:20:58 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Overwriting current allocation {'allocations': {'c90f7e3d-8e75-47f9-93b3-09ecdef87e26': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 33}}, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'consumer_generation': 1} on consumer 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG os_brick.utils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa56901-ae85-4a03-a3dc-373c709ecf9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b0a8b-b267-474d-a666-85282e00b745]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1458f6f-fe47-4fb8-88be-964a13eb6b8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[198b19d6-6c55-4763-9875-7f2d6f0b507d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:20:59 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b14295-c8df-4e31-87f5-3499b68c2bb7]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG os_brick.utils [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:20:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [{"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-582e004b-a2f3-4397-9ccb-d23f5724ebe1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:00 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:21:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=26.238910675048828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 7296c02e-f468-45b9-b037-e6cd240dd27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7b91dda-27c6-4bcd-99ec-c818c5c93373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bfd52279-f440-48cb-9c97-8133c7322482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Starting finish_revert_migration {{(pid=82009) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start _get_guest_xml network_info=[{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '18204288-7193-44df-aec6-acc18a3e2ace', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1adc9f1d-cc32-446e-9ffc-5fada2383164', 'attached_at': '2023-04-11T18:21:05.000000', 'detached_at': '', 'volume_id': '314d5532-2e55-4c33-84fc-47a99b78f74a', 'serial': '314d5532-2e55-4c33-84fc-47a99b78f74a'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:21:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:21:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:21:04 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:21:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:21:04 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:21:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:21:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:21:04 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed93c2-25a3-4fa6-9b26-1ccb5911c476]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:21:05 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eef92f-72c5-4c45-88b8-dacd8fdbabfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a] added
Apr 11 18:21:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3cccb8-af3e-4272-982f-4c5dde5902e8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93cfc30-4b8e-4763-8dad-138b74800cd1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyCaJwWZ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyCaJwWZ" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39b215-2d70-4d21-98d7-3b6d0b0d5414]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyCaJwWZ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d3de0-f9bd-4f0e-8eb9-75794a65ed62]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42082f-2deb-428d-b9c4-45184fa4f451]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.818s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90c5d5-174d-4fdb-ae7d-b23f8126e5a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]
Apr 11 18:21:05 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.
Apr 11 18:21:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1810d8e9-6de9-4082-a3fb-3513324f4e48]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c90e88-cc58-458e-b744-5fb0e2f7ff3c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:21:05 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:05 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5ac01-db97-4354-b06b-aa76fb2dd9ab]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:21:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26563303561346464', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563303561346464', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:21:06 user nova-compute[82009]:   <uuid>1adc9f1d-cc32-446e-9ffc-5fada2383164</uuid>
Apr 11 18:21:06 user nova-compute[82009]:   <name>instance-00000006</name>
Apr 11 18:21:06 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:21:06 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:21:06 user nova-compute[82009]:   <metadata>
Apr 11 18:21:06 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:21:06 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:21:06 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-731201773</nova:name>
Apr 11 18:21:06 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:21:04</nova:creationTime>
Apr 11 18:21:06 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:21:06 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:21:06 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:21:06 user nova-compute[82009]:       <nova:owner>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:21:06 user nova-compute[82009]:       </nova:owner>
Apr 11 18:21:06 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:21:06 user nova-compute[82009]:       <nova:ports>
Apr 11 18:21:06 user nova-compute[82009]:         <nova:port uuid="98cc8035-8d3e-47cf-9758-c7172120ac70">
Apr 11 18:21:06 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 18:21:06 user nova-compute[82009]:         </nova:port>
Apr 11 18:21:06 user nova-compute[82009]:       </nova:ports>
Apr 11 18:21:06 user nova-compute[82009]:     </nova:instance>
Apr 11 18:21:06 user nova-compute[82009]:   </metadata>
Apr 11 18:21:06 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:21:06 user nova-compute[82009]:     <system>
Apr 11 18:21:06 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:21:06 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:21:06 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:21:06 user nova-compute[82009]:       <entry name="serial">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:21:06 user nova-compute[82009]:       <entry name="uuid">1adc9f1d-cc32-446e-9ffc-5fada2383164</entry>
Apr 11 18:21:06 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:21:06 user nova-compute[82009]:     </system>
Apr 11 18:21:06 user nova-compute[82009]:   </sysinfo>
Apr 11 18:21:06 user nova-compute[82009]:   <os>
Apr 11 18:21:06 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:21:06 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:21:06 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:21:06 user nova-compute[82009]:   </os>
Apr 11 18:21:06 user nova-compute[82009]:   <features>
Apr 11 18:21:06 user nova-compute[82009]:     <acpi/>
Apr 11 18:21:06 user nova-compute[82009]:     <apic/>
Apr 11 18:21:06 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:21:06 user nova-compute[82009]:   </features>
Apr 11 18:21:06 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:21:06 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:21:06 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:21:06 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:21:06 user nova-compute[82009]:   </clock>
Apr 11 18:21:06 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:21:06 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:21:06 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:21:06 user nova-compute[82009]:   </cpu>
Apr 11 18:21:06 user nova-compute[82009]:   <devices>
Apr 11 18:21:06 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:21:06 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:21:06 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk"/>
Apr 11 18:21:06 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:21:06 user nova-compute[82009]:     </disk>
Apr 11 18:21:06 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:21:06 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:21:06 user nova-compute[82009]:       <source dev="/dev/sdc"/>
Apr 11 18:21:06 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:21:06 user nova-compute[82009]:       <serial>314d5532-2e55-4c33-84fc-47a99b78f74a</serial>
Apr 11 18:21:06 user nova-compute[82009]:     </disk>
Apr 11 18:21:06 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:21:06 user nova-compute[82009]:       <mac address="fa:16:3e:fd:e3:b5"/>
Apr 11 18:21:06 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:21:06 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:21:06 user nova-compute[82009]:       <target dev="tap98cc8035-8d"/>
Apr 11 18:21:06 user nova-compute[82009]:     </interface>
Apr 11 18:21:06 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:21:06 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/console.log" append="off"/>
Apr 11 18:21:06 user nova-compute[82009]:     </serial>
Apr 11 18:21:06 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:21:06 user nova-compute[82009]:     <video>
Apr 11 18:21:06 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:21:06 user nova-compute[82009]:     </video>
Apr 11 18:21:06 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:21:06 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:21:06 user nova-compute[82009]:     </rng>
Apr 11 18:21:06 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:21:06 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:21:06 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:21:06 user nova-compute[82009]:     </memballoon>
Apr 11 18:21:06 user nova-compute[82009]:   </devices>
Apr 11 18:21:06 user nova-compute[82009]: </domain>
Apr 11 18:21:06 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG os_vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cc8035-8d, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98cc8035-8d, col_values=(('external_ids', {'iface-id': '98cc8035-8d3e-47cf-9758-c7172120ac70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e3:b5', 'vm-uuid': '1adc9f1d-cc32-446e-9ffc-5fada2383164'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:06 user nova-compute[82009]: INFO os_vif [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:21:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-changed-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Refreshing instance network info cache due to event network-changed-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Acquiring lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Acquired lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:21:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Refreshing network info cache for port 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:07 user nova-compute[82009]: INFO nova.compute.manager [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Terminating instance
Apr 11 18:21:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing instance network info cache due to event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updated VIF entry in instance network info cache for port 4c4d2ca4-ad67-4059-ae14-fcaece35e4ed. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG nova.network.neutron [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updating instance_info_cache with network_info: [{"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3a1b4c4-d3c3-42be-8045-117328023690 req-690d2973-62df-419c-843d-71f935f2c056 service nova] Releasing lock "refresh_cache-e7b91dda-27c6-4bcd-99ec-c818c5c93373" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:08 user nova-compute[82009]: WARNING nova.compute.manager [req-1ea121c4-686e-412c-b4a6-2c22eb6ae501 req-06801534-df16-4c6a-bdeb-a4d609668437 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state resized and task_state resize_reverting.
Apr 11 18:21:08 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Instance destroyed successfully.
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'resources' on Instance uuid e7b91dda-27c6-4bcd-99ec-c818c5c93373 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2124334392',display_name='tempest-TestStampPattern-server-2124334392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2124334392',id=23,image_ref='041c5dfa-75b5-40fd-88b4-c15489d9c57b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA==',key_name='tempest-TestStampPattern-1363613236',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86e02898b1bc4378822244d9522ff042',ramdisk_id='',reservation_id='r-1eoguptz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='91bf5195-b2bc-48ca-9632-5ae616090fd2',image_min_disk='1',image_min_ram='0',image_owner_id='86e02898b1bc4378822244d9522ff042',image_owner_project_name='tempest-TestStampPattern-1680133886',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1680133886-project-member',image_user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',owner_project_name='tempest-TestStampPattern-1680133886',owner_user_name='tempest-TestStampPattern-1680133886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:18:23Z,user_data=None,user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',uuid=e7b91dda-27c6-4bcd-99ec-c818c5c93373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converting VIF {"id": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "address": "fa:16:3e:0d:7a:a6", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4d2ca4-ad", "ovs_interfaceid": "4c4d2ca4-ad67-4059-ae14-fcaece35e4ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG os_vif [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c4d2ca4-ad, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: INFO os_vif [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7a:a6,bridge_name='br-int',has_traffic_filtering=True,id=4c4d2ca4-ad67-4059-ae14-fcaece35e4ed,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4d2ca4-ad')
Apr 11 18:21:08 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Deleting instance files /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373_del
Apr 11 18:21:08 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Deletion of /opt/stack/data/nova/instances/e7b91dda-27c6-4bcd-99ec-c818c5c93373_del complete
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:08 user nova-compute[82009]: INFO nova.compute.manager [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Took 1.40 seconds to destroy the instance on the hypervisor.
Apr 11 18:21:08 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updated VIF entry in instance network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-270bbb05-3692-4d7a-bda6-ee671174aa51 req-3647de3d-df93-4fd0-9cbb-9ccae6207b7d service nova] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-vif-unplugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] No waiting events found dispatching network-vif-unplugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-vif-unplugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Acquiring lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] No waiting events found dispatching network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:09 user nova-compute[82009]: WARNING nova.compute.manager [req-de138e93-6dee-4c62-a30f-38fed4dc5882 req-d804997b-5a8b-4e67-9a19-a000c6a76511 service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received unexpected event network-vif-plugged-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed for instance with vm_state active and task_state deleting.
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:09 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Took 1.38 seconds to deallocate network for instance.
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Received event network-vif-deleted-4c4d2ca4-ad67-4059-ae14-fcaece35e4ed {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing instance network info cache due to event network-changed-23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Acquiring lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Acquired lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Refreshing network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Detaching volume a5c165e2-cf22-4292-a456-43dde9aacda5
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.virt.block_device [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Attempting to driver detach volume a5c165e2-cf22-4292-a456-43dde9aacda5 from mountpoint /dev/vdb
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Detaching volume a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:10 user nova-compute[82009]: WARNING nova.compute.manager [req-1a405444-6cbf-4221-aaca-a1054ee6a4f4 req-59b01713-6213-48c7-b498-89ae98b560c2 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state resized and task_state resize_reverting.
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Attempting to detach device vdb from instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:21:10 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:21:10 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:21:10 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:21:10 user nova-compute[82009]:   <serial>a5c165e2-cf22-4292-a456-43dde9aacda5</serial>
Apr 11 18:21:10 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:21:10 user nova-compute[82009]: </disk>
Apr 11 18:21:10 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully detached device vdb from instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd from the persistent domain config.
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:21:10 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:21:10 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:21:10 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:21:10 user nova-compute[82009]:   <serial>a5c165e2-cf22-4292-a456-43dde9aacda5</serial>
Apr 11 18:21:10 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:21:10 user nova-compute[82009]: </disk>
Apr 11 18:21:10 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.virt.block_device [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Attempting to driver detach volume a3861b91-6351-4328-8e27-bbffbd356684 from mountpoint /dev/vdb
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Attempting to detach device vdb from instance 7296c02e-f468-45b9-b037-e6cd240dd27d from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:21:10 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:21:10 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:21:10 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:21:10 user nova-compute[82009]:   <serial>a3861b91-6351-4328-8e27-bbffbd356684</serial>
Apr 11 18:21:10 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:21:10 user nova-compute[82009]: </disk>
Apr 11 18:21:10 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully detached device vdb from instance 7296c02e-f468-45b9-b037-e6cd240dd27d from the persistent domain config.
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7296c02e-f468-45b9-b037-e6cd240dd27d from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:21:10 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:21:10 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:21:10 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:21:10 user nova-compute[82009]:   <serial>a3861b91-6351-4328-8e27-bbffbd356684</serial>
Apr 11 18:21:10 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:21:10 user nova-compute[82009]: </disk>
Apr 11 18:21:10 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 1adc9f1d-cc32-446e-9ffc-5fada2383164 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237270.3554897, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Resumed (Lifecycle Event)
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance running successfully.
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] finish_revert_migration finished successfully. {{(pid=82009) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237270.3567553, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Started (Lifecycle Event)
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Deleted allocations for instance e7b91dda-27c6-4bcd-99ec-c818c5c93373
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.compute.manager [None req-3a7072bf-7bd5-4c0b-a08a-f8904bbb5816 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance to original state: 'active'
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updated VIF entry in instance network info cache for port 23c3497e-9e98-496c-b81b-3ce400105b1b. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [{"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8a0fa0fd-aa4c-4b1b-b676-78e7f4c21a90 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "e7b91dda-27c6-4bcd-99ec-c818c5c93373" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.516s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c4c755fa-7d29-4481-8da6-6b6489743b68 req-51cc092e-256c-4af9-9153-60a5c8a2a45e service nova] Releasing lock "refresh_cache-7296c02e-f468-45b9-b037-e6cd240dd27d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237270.6978602, 671f8fb2-8d06-4766-921f-a3ceb83f4bbd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:21:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully detached device vdb from instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd from the live domain config.
Apr 11 18:21:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfMqEnpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:21:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd0d34-2854-42cd-ab6b-97d4fdaa8857]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:21:10 user nova-compute[82009]: No targets found.
Apr 11 18:21:10 user nova-compute[82009]: iSNS:
Apr 11 18:21:10 user nova-compute[82009]: No targets found.
Apr 11 18:21:10 user nova-compute[82009]: STATIC:
Apr 11 18:21:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:21:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:21:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5
Apr 11 18:21:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:21:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:21:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:10 user nova-compute[82009]: FIRMWARE:
Apr 11 18:21:10 user nova-compute[82009]: No targets found.
Apr 11 18:21:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:21:10 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:21:10 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f15c6f-58f4-4e22-8faf-f68c01d171e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16a2e5-6c68-4e12-9092-0b77ec7ded94]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 (non-flash)
Apr 11 18:21:10 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e03f7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a5cd0-15e1-4157-a171-9319e25a17dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5119f5f-dd05-44fd-9264-47dda03c1f3b]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67c109-0f32-4c5d-aa76-3cf65360f539]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5250c51b-4559-4c0b-92ad-d226f0d495f5]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[07835449-42a7-46d8-818f-f7f32a58713d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1685c7e6-2933-4ef5-bc1c-2267ba42ed05]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260]
Apr 11 18:21:11 user nova-compute[82009]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5, portal: 172.16.0.220,3260] successful.
Apr 11 18:21:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237271.012494, 7296c02e-f468-45b9-b037-e6cd240dd27d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:21:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully detached device vdb from instance 7296c02e-f468-45b9-b037-e6cd240dd27d from the live domain config.
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFlQadVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:21:11 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc51043-b65a-476a-8d0f-e9343ecff39b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== disconnect_volume: return (333ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.027s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253a1e4-4023-4ed7-a588-1a8a69633bdf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:21:11 user nova-compute[82009]: No targets found.
Apr 11 18:21:11 user nova-compute[82009]: iSNS:
Apr 11 18:21:11 user nova-compute[82009]: No targets found.
Apr 11 18:21:11 user nova-compute[82009]: STATIC:
Apr 11 18:21:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:21:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:21:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:21:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684
Apr 11 18:21:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:11 user nova-compute[82009]: FIRMWARE:
Apr 11 18:21:11 user nova-compute[82009]: No targets found.
Apr 11 18:21:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:21:11 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:21:11 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4170a9a2-984c-492b-8e7b-f9f0a210bf54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e931233-470e-44c1-9990-5aeec3dc85f5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:11 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:11 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:11 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 (non-flash)
Apr 11 18:21:11 user nova-compute[82009]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:11 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:11 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e0417eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28b99f2-fbea-403b-b922-8a409d7fba7f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8c905e-d970-4db2-9ea9-7e0df10d4f83]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd86804-05e8-4b8f-b582-f89ef389df8b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107d682-1555-4a28-aabe-9df5e96d5d56]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[301af451-5bfd-469c-9da9-60ffefb06238]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0aa045-b412-4f75-805d-69efd95afe83]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260]
Apr 11 18:21:11 user nova-compute[82009]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684, portal: 172.16.0.220,3260] successful.
Apr 11 18:21:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3861b91-6351-4328-8e27-bbffbd356684 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ae7a6-a698-4cd3-8b63-8ad81ef84d67]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] <== disconnect_volume: return (480ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'flavor' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-488d6f57-1d75-4c43-bfba-c66c0f8d6a94 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.815s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.677s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:11 user nova-compute[82009]: INFO nova.compute.manager [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Terminating instance
Apr 11 18:21:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-vif-unplugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] No waiting events found dispatching network-vif-unplugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-7f8531f6-7bae-478e-b8a7-62ca3415b37a req-1f7ab351-f082-4f32-b929-6e85c5a9c2d7 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-vif-unplugged-acc2e042-39c9-42c0-9fbe-405412bba1af for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'flavor' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c82b48e0-8c9f-4b69-990e-d164a6e7725c tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.183s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Instance destroyed successfully.
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'resources' on Instance uuid 671f8fb2-8d06-4766-921f-a3ceb83f4bbd {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1793009425',display_name='tempest-VolumesSnapshotTestJSON-instance-1793009425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1793009425',id=25,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde6ebc41bed44f1a04e23e62cd9ac0d',ramdisk_id='',reservation_id='r-k75wi5ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-251988417',owner_user_name='tempest-VolumesSnapshotTestJSON-251988417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:19:13Z,user_data=None,user_id='5fdf10ea561448f689cdd2d052080168',uuid=671f8fb2-8d06-4766-921f-a3ceb83f4bbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converting VIF {"id": "acc2e042-39c9-42c0-9fbe-405412bba1af", "address": "fa:16:3e:16:fe:cf", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc2e042-39", "ovs_interfaceid": "acc2e042-39c9-42c0-9fbe-405412bba1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_vif [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc2e042-39, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:12 user nova-compute[82009]: INFO os_vif [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:fe:cf,bridge_name='br-int',has_traffic_filtering=True,id=acc2e042-39c9-42c0-9fbe-405412bba1af,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc2e042-39')
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfMqEnpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:21:12 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c793a54d-c9ad-4c1e-bfc3-113adc7bc80f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:21:12 user nova-compute[82009]: No targets found.
Apr 11 18:21:12 user nova-compute[82009]: iSNS:
Apr 11 18:21:12 user nova-compute[82009]: No targets found.
Apr 11 18:21:12 user nova-compute[82009]: STATIC:
Apr 11 18:21:12 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:21:12 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:12 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:12 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:21:12 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:12 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:12 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:21:12 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:21:12 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:21:12 user nova-compute[82009]: FIRMWARE:
Apr 11 18:21:12 user nova-compute[82009]: No targets found.
Apr 11 18:21:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:21:12 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:21:12 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c165e2-cf22-4292-a456-43dde9aacda5', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d239a1-7fd3-446d-9c4c-8576e60a309e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb57b6-8070-4b8e-a0b6-1f5039c475fe]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:12 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:12 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:21:12 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:21:12 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:21:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6cc3370>, {}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Disconnecting from: [] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== disconnect_volume: return (74ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:21:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Deleting instance files /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd_del
Apr 11 18:21:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Deletion of /opt/stack/data/nova/instances/671f8fb2-8d06-4766-921f-a3ceb83f4bbd_del complete
Apr 11 18:21:12 user nova-compute[82009]: INFO nova.compute.manager [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 11 18:21:12 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:21:12 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:21:13 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:13 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Took 0.49 seconds to deallocate network for instance.
Apr 11 18:21:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-e11e7849-c60b-479e-a4fa-022ce745175d req-d9125a11-26f5-449b-8182-e588c95c1d80 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-vif-deleted-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:13 user nova-compute[82009]: WARNING nova.volume.cinder [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Attachment 83a268cb-fde9-4014-b45f-3ddbff56597c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 83a268cb-fde9-4014-b45f-3ddbff56597c. (HTTP 404) (Request-ID: req-790aec82-a1ab-4aa1-a901-4d58e5993dc6)
Apr 11 18:21:13 user nova-compute[82009]: INFO nova.compute.manager [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Took 0.03 seconds to detach 1 volumes for instance.
Apr 11 18:21:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:13 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:21:13 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:21:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:13 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Deleted allocations for instance 671f8fb2-8d06-4766-921f-a3ceb83f4bbd
Apr 11 18:21:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-bab94bed-b68b-46ae-8144-f9d716907e4a tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.997s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received event network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Acquiring lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] Lock "671f8fb2-8d06-4766-921f-a3ceb83f4bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] No waiting events found dispatching network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:14 user nova-compute[82009]: WARNING nova.compute.manager [req-57fff9ea-5f30-4dc3-90cd-8db8825312e8 req-b3ad3c3b-29f5-4a65-a843-b16791bf7744 service nova] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Received unexpected event network-vif-plugged-acc2e042-39c9-42c0-9fbe-405412bba1af for instance with vm_state deleted and task_state None.
Apr 11 18:21:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:23 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237268.350722, e7b91dda-27c6-4bcd-99ec-c818c5c93373 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:21:23 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] VM Stopped (Lifecycle Event)
Apr 11 18:21:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-93cd5d1a-956f-4f24-a42b-d7fa82c4918f None None] [instance: e7b91dda-27c6-4bcd-99ec-c818c5c93373] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:21:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:27 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237272.7057145, 671f8fb2-8d06-4766-921f-a3ceb83f4bbd => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:21:27 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] VM Stopped (Lifecycle Event)
Apr 11 18:21:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c7ea0182-df6b-4ab5-96db-4b582cf2c5f8 None None] [instance: 671f8fb2-8d06-4766-921f-a3ceb83f4bbd] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:21:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:29 user nova-compute[82009]: INFO nova.compute.manager [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Terminating instance
Apr 11 18:21:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-unplugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-unplugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-3abc8eb5-8696-429a-8c01-38e42790fa1b req-687ba0a6-c1d7-4d92-9336-66e09e75f232 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-unplugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:21:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Instance destroyed successfully.
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'resources' on Instance uuid 582e004b-a2f3-4397-9ccb-d23f5724ebe1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1005799066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1005799066',id=18,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9a9nPmAjerdldl6YPoScXwpgamwr3rJP1TIHx991AR4t6+N4RmymMGiHE3v2lIBtDFvIO76lEEbpVn4KSmVi5IAdIIF3VrPq8fW57dXsGj5RDaIQss3YEolDQ5cNSocQ==',key_name='tempest-keypair-504297625',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-i8mh72dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=582e004b-a2f3-4397-9ccb-d23f5724ebe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "address": "fa:16:3e:80:b4:71", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d33cf-42", "ovs_interfaceid": "f85d33cf-427d-4b1c-ac2a-da35c15cdb90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG os_vif [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85d33cf-42, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:30 user nova-compute[82009]: INFO os_vif [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:b4:71,bridge_name='br-int',has_traffic_filtering=True,id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d33cf-42')
Apr 11 18:21:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Deleting instance files /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1_del
Apr 11 18:21:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Deletion of /opt/stack/data/nova/instances/582e004b-a2f3-4397-9ccb-d23f5724ebe1_del complete
Apr 11 18:21:30 user nova-compute[82009]: INFO nova.compute.manager [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 18:21:30 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:30 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Took 0.68 seconds to deallocate network for instance.
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-deleted-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:30 user nova-compute[82009]: INFO nova.compute.manager [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Neutron deleted interface f85d33cf-427d-4b1c-ac2a-da35c15cdb90; detaching it from the instance and deleting it from the info cache
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-8e8f2277-ca4e-4c8e-94b9-b8ae9689aa16 req-13568a81-70ba-4b3c-95cb-92c3b9abd59e service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Detach interface failed, port_id=f85d33cf-427d-4b1c-ac2a-da35c15cdb90, reason: Instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:31 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Deleted allocations for instance 582e004b-a2f3-4397-9ccb-d23f5724ebe1
Apr 11 18:21:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-74929523-34d2-4c28-a58e-5be7eb09401c tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Acquiring lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] Lock "582e004b-a2f3-4397-9ccb-d23f5724ebe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:21:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] No waiting events found dispatching network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:21:31 user nova-compute[82009]: WARNING nova.compute.manager [req-40c00d04-6a87-4b05-95af-8b228d6c11a1 req-17eb9244-44f9-4184-9895-92e59bf6ef81 service nova] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Received unexpected event network-vif-plugged-f85d33cf-427d-4b1c-ac2a-da35c15cdb90 for instance with vm_state deleted and task_state None.
Apr 11 18:21:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:45 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237290.1453097, 582e004b-a2f3-4397-9ccb-d23f5724ebe1 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:21:45 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] VM Stopped (Lifecycle Event)
Apr 11 18:21:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a5e88d52-90f1-49d5-b0a8-9de2af2576dc None None] [instance: 582e004b-a2f3-4397-9ccb-d23f5724ebe1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:21:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:21:58 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:21:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:21:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:21:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:21:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-changed-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Refreshing instance network info cache due to event network-changed-ca931e62-5efe-439f-831c-1792c67eae7f. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Acquiring lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Acquired lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG nova.network.neutron [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Refreshing network info cache for port ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:01 user nova-compute[82009]: INFO nova.compute.manager [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Terminating instance
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-vif-unplugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] No waiting events found dispatching network-vif-unplugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-bae1efe4-0aa9-4dcf-84cc-e249a7d65a6e req-c4513c50-3098-4cb8-84a6-3ae7a4fbac28 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-vif-unplugged-ca931e62-5efe-439f-831c-1792c67eae7f for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updated VIF entry in instance network info cache for port ca931e62-5efe-439f-831c-1792c67eae7f. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [{"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-296b9adc-f93f-47d7-9ccb-765b8b7c114f req-a230a37b-744f-460b-82aa-b5b84ffa02c4 service nova] Releasing lock "refresh_cache-91bf5195-b2bc-48ca-9632-5ae616090fd2" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Instance destroyed successfully.
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.objects.instance [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lazy-loading 'resources' on Instance uuid 91bf5195-b2bc-48ca-9632-5ae616090fd2 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1875082957',display_name='tempest-TestStampPattern-server-1875082957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1875082957',id=19,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXEmGnM+eDpAxKVu536xg1MilgjukVR49WzRHE1fEMyldSYxjfH8FFOVpCi5cKPPzq5QosxTg5QA/Cng2S7VVPvh3TS2c4r5JWbBfqFyRcG4h5Epu52qfuf91O6grj9PA==',key_name='tempest-TestStampPattern-1363613236',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86e02898b1bc4378822244d9522ff042',ramdisk_id='',reservation_id='r-w52s19na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1680133886',owner_user_name='tempest-TestStampPattern-1680133886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:18:14Z,user_data=None,user_id='c44e6b75d86f4ff0b6f93123ce15ccc0',uuid=91bf5195-b2bc-48ca-9632-5ae616090fd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converting VIF {"id": "ca931e62-5efe-439f-831c-1792c67eae7f", "address": "fa:16:3e:23:ef:f2", "network": {"id": "6c15015e-33ba-4615-94fd-f8253338eb8a", "bridge": "br-int", "label": "tempest-TestStampPattern-1420941092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86e02898b1bc4378822244d9522ff042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca931e62-5e", "ovs_interfaceid": "ca931e62-5efe-439f-831c-1792c67eae7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG os_vif [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca931e62-5e, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:01 user nova-compute[82009]: INFO os_vif [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ef:f2,bridge_name='br-int',has_traffic_filtering=True,id=ca931e62-5efe-439f-831c-1792c67eae7f,network=Network(6c15015e-33ba-4615-94fd-f8253338eb8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca931e62-5e')
Apr 11 18:22:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Deleting instance files /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2_del
Apr 11 18:22:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Deletion of /opt/stack/data/nova/instances/91bf5195-b2bc-48ca-9632-5ae616090fd2_del complete
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:01 user nova-compute[82009]: INFO nova.compute.manager [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 11 18:22:01 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:22:01 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-vif-deleted-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:02 user nova-compute[82009]: INFO nova.compute.manager [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Neutron deleted interface ca931e62-5efe-439f-831c-1792c67eae7f; detaching it from the instance and deleting it from the info cache
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.network.neutron [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:02 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Took 0.51 seconds to deallocate network for instance.
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-f98ba8d6-97c1-410d-8910-057a3f163ed7 req-9fdd7555-c857-41de-966e-a26a7a6061d3 service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Detach interface failed, port_id=ca931e62-5efe-439f-831c-1792c67eae7f, reason: Instance 91bf5195-b2bc-48ca-9632-5ae616090fd2 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:02 user nova-compute[82009]: INFO nova.compute.manager [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Terminating instance
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:22:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:03 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '91bf5195-b2bc-48ca-9632-5ae616090fd2' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '91bf5195-b2bc-48ca-9632-5ae616090fd2' (instance-00000013)
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:03 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Deleted allocations for instance 91bf5195-b2bc-48ca-9632-5ae616090fd2
Apr 11 18:22:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eec10e7f-85d5-47d0-bc1a-a0cb82822d91 tempest-TestStampPattern-1680133886 tempest-TestStampPattern-1680133886-project-member] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-e2ab5650-2d74-4a60-a0dc-3f1f01ead1d8 req-be938e0a-d410-4950-b882-9ff90538eee0 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received event network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Acquiring lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] Lock "91bf5195-b2bc-48ca-9632-5ae616090fd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] No waiting events found dispatching network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:03 user nova-compute[82009]: WARNING nova.compute.manager [req-cf284d80-44e7-453f-a62b-dff203dc0b01 req-afe6d751-7cbb-42b0-9805-11d96d896cac service nova] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Received unexpected event network-vif-plugged-ca931e62-5efe-439f-831c-1792c67eae7f for instance with vm_state deleted and task_state None.
Apr 11 18:22:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=26.347610473632812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Instance destroyed successfully.
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lazy-loading 'resources' on Instance uuid 7296c02e-f468-45b9-b037-e6cd240dd27d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412604929',display_name='tempest-TestMinimumBasicScenario-server-1412604929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412604929',id=22,image_ref='ae202131-1e90-4b52-a842-aa146ab12536',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0dOv+vq9gsgidD6e8GZkhomJp382UjYsmrw934PhdaAUHmUcG7KAhr8HRtwnN2nsKzabe5u5w0n4NM+BgKevuPnPr+IH9jOhoaX2NUYaoSjcye13Ow4Y+ibxlYeX9n8Q==',key_name='tempest-TestMinimumBasicScenario-654518614',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70e133c013140e1a17804737f4e3ef7',ramdisk_id='',reservation_id='r-6kg5qfvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ae202131-1e90-4b52-a842-aa146ab12536',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-492134328',owner_user_name='tempest-TestMinimumBasicScenario-492134328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:19:26Z,user_data=None,user_id='dd1c4ded6c544d6eb16e9086c6259750',uuid=7296c02e-f468-45b9-b037-e6cd240dd27d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converting VIF {"id": "23c3497e-9e98-496c-b81b-3ce400105b1b", "address": "fa:16:3e:33:a4:b3", "network": {"id": "bd1220d9-28b4-4637-b373-8e8e6cc4131f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484539042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70e133c013140e1a17804737f4e3ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c3497e-9e", "ovs_interfaceid": "23c3497e-9e98-496c-b81b-3ce400105b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG os_vif [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23c3497e-9e, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: INFO os_vif [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=23c3497e-9e98-496c-b81b-3ce400105b1b,network=Network(bd1220d9-28b4-4637-b373-8e8e6cc4131f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c3497e-9e')
Apr 11 18:22:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Deleting instance files /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d_del
Apr 11 18:22:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Deletion of /opt/stack/data/nova/instances/7296c02e-f468-45b9-b037-e6cd240dd27d_del complete
Apr 11 18:22:04 user nova-compute[82009]: INFO nova.compute.manager [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Took 1.40 seconds to destroy the instance on the hypervisor.
Apr 11 18:22:04 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 7296c02e-f468-45b9-b037-e6cd240dd27d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bfd52279-f440-48cb-9c97-8133c7322482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:04 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:05 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Took 0.66 seconds to deallocate network for instance.
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-4498c7b0-5e14-45e0-b141-aeadfd29da46 req-050f8147-f7b6-4c1c-9c06-435f279923e8 service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-deleted-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:05 user nova-compute[82009]: WARNING nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state deleted and task_state None.
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:05 user nova-compute[82009]: WARNING nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state deleted and task_state None.
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:05 user nova-compute[82009]: WARNING nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state deleted and task_state None.
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:05 user nova-compute[82009]: WARNING nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-unplugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state deleted and task_state None.
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Acquiring lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] No waiting events found dispatching network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:05 user nova-compute[82009]: WARNING nova.compute.manager [req-f1854a9f-bff4-4ab3-8c20-0713a40cf970 req-eae336c7-17e2-48b7-a1c1-f2f1647a583f service nova] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Received unexpected event network-vif-plugged-23c3497e-9e98-496c-b81b-3ce400105b1b for instance with vm_state deleted and task_state None.
Apr 11 18:22:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:05 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Deleted allocations for instance 7296c02e-f468-45b9-b037-e6cd240dd27d
Apr 11 18:22:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-94c659c3-a389-4003-938e-f051ebdc9803 tempest-TestMinimumBasicScenario-492134328 tempest-TestMinimumBasicScenario-492134328-project-member] Lock "7296c02e-f468-45b9-b037-e6cd240dd27d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:22:07 user nova-compute[82009]: INFO nova.compute.claims [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Claim successful on node user
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:22:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.policy [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fdf10ea561448f689cdd2d052080168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6ebc41bed44f1a04e23e62cd9ac0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:22:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Creating image(s)
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "/opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "/opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk 1073741824" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Successfully created port: 3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Cannot resize image /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'migration_context' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Ensure instance console log exists: /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Successfully updated port: 3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "refresh_cache-bc37cbdb-1665-41de-bac9-b7fcf976c048" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquired lock "refresh_cache-bc37cbdb-1665-41de-bac9-b7fcf976c048" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-changed-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Refreshing instance network info cache due to event network-changed-3d6e7b56-6149-4e34-8c82-9aa71a2d73db. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Acquiring lock "refresh_cache-bc37cbdb-1665-41de-bac9-b7fcf976c048" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Updating instance_info_cache with network_info: [{"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Releasing lock "refresh_cache-bc37cbdb-1665-41de-bac9-b7fcf976c048" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Instance network_info: |[{"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Acquired lock "refresh_cache-bc37cbdb-1665-41de-bac9-b7fcf976c048" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Refreshing network info cache for port 3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Start _get_guest_xml network_info=[{"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:22:09 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:09 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601205193',display_name='tempest-VolumesSnapshotTestJSON-instance-1601205193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601205193',id=28,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde6ebc41bed44f1a04e23e62cd9ac0d',ramdisk_id='',reservation_id='r-06v6jsi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-251988417',owner_user_name='tempest-VolumesSnapshotTestJSON-251988417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:22:08Z,user_data=None,user_id='5fdf10ea561448f689cdd2d052080168',uuid=bc37cbdb-1665-41de-bac9-b7fcf976c048,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converting VIF {"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'pci_devices' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:22:09 user nova-compute[82009]:   <uuid>bc37cbdb-1665-41de-bac9-b7fcf976c048</uuid>
Apr 11 18:22:09 user nova-compute[82009]:   <name>instance-0000001c</name>
Apr 11 18:22:09 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:22:09 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:22:09 user nova-compute[82009]:   <metadata>
Apr 11 18:22:09 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:22:09 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:22:09 user nova-compute[82009]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1601205193</nova:name>
Apr 11 18:22:09 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:22:09</nova:creationTime>
Apr 11 18:22:09 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:22:09 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:22:09 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:22:09 user nova-compute[82009]:       <nova:owner>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:user uuid="5fdf10ea561448f689cdd2d052080168">tempest-VolumesSnapshotTestJSON-251988417-project-member</nova:user>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:project uuid="fde6ebc41bed44f1a04e23e62cd9ac0d">tempest-VolumesSnapshotTestJSON-251988417</nova:project>
Apr 11 18:22:09 user nova-compute[82009]:       </nova:owner>
Apr 11 18:22:09 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:22:09 user nova-compute[82009]:       <nova:ports>
Apr 11 18:22:09 user nova-compute[82009]:         <nova:port uuid="3d6e7b56-6149-4e34-8c82-9aa71a2d73db">
Apr 11 18:22:09 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 18:22:09 user nova-compute[82009]:         </nova:port>
Apr 11 18:22:09 user nova-compute[82009]:       </nova:ports>
Apr 11 18:22:09 user nova-compute[82009]:     </nova:instance>
Apr 11 18:22:09 user nova-compute[82009]:   </metadata>
Apr 11 18:22:09 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:22:09 user nova-compute[82009]:     <system>
Apr 11 18:22:09 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:22:09 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:22:09 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:22:09 user nova-compute[82009]:       <entry name="serial">bc37cbdb-1665-41de-bac9-b7fcf976c048</entry>
Apr 11 18:22:09 user nova-compute[82009]:       <entry name="uuid">bc37cbdb-1665-41de-bac9-b7fcf976c048</entry>
Apr 11 18:22:09 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:22:09 user nova-compute[82009]:     </system>
Apr 11 18:22:09 user nova-compute[82009]:   </sysinfo>
Apr 11 18:22:09 user nova-compute[82009]:   <os>
Apr 11 18:22:09 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:22:09 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:22:09 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:22:09 user nova-compute[82009]:   </os>
Apr 11 18:22:09 user nova-compute[82009]:   <features>
Apr 11 18:22:09 user nova-compute[82009]:     <acpi/>
Apr 11 18:22:09 user nova-compute[82009]:     <apic/>
Apr 11 18:22:09 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:22:09 user nova-compute[82009]:   </features>
Apr 11 18:22:09 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:22:09 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:22:09 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:22:09 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:22:09 user nova-compute[82009]:   </clock>
Apr 11 18:22:09 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:22:09 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:22:09 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:22:09 user nova-compute[82009]:   </cpu>
Apr 11 18:22:09 user nova-compute[82009]:   <devices>
Apr 11 18:22:09 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:22:09 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:22:09 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk"/>
Apr 11 18:22:09 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:22:09 user nova-compute[82009]:     </disk>
Apr 11 18:22:09 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:22:09 user nova-compute[82009]:       <mac address="fa:16:3e:81:7b:39"/>
Apr 11 18:22:09 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:22:09 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:22:09 user nova-compute[82009]:       <target dev="tap3d6e7b56-61"/>
Apr 11 18:22:09 user nova-compute[82009]:     </interface>
Apr 11 18:22:09 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:22:09 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/console.log" append="off"/>
Apr 11 18:22:09 user nova-compute[82009]:     </serial>
Apr 11 18:22:09 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:22:09 user nova-compute[82009]:     <video>
Apr 11 18:22:09 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:22:09 user nova-compute[82009]:     </video>
Apr 11 18:22:09 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:22:09 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:22:09 user nova-compute[82009]:     </rng>
Apr 11 18:22:09 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:22:09 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:22:09 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:22:09 user nova-compute[82009]:     </memballoon>
Apr 11 18:22:09 user nova-compute[82009]:   </devices>
Apr 11 18:22:09 user nova-compute[82009]: </domain>
Apr 11 18:22:09 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601205193',display_name='tempest-VolumesSnapshotTestJSON-instance-1601205193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601205193',id=28,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fde6ebc41bed44f1a04e23e62cd9ac0d',ramdisk_id='',reservation_id='r-06v6jsi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-251988417',owner_user_name='tempest-VolumesSnapshotTestJSON-251988417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:22:08Z,user_data=None,user_id='5fdf10ea561448f689cdd2d052080168',uuid=bc37cbdb-1665-41de-bac9-b7fcf976c048,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converting VIF {"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG os_vif [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d6e7b56-61, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d6e7b56-61, col_values=(('external_ids', {'iface-id': '3d6e7b56-6149-4e34-8c82-9aa71a2d73db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:7b:39', 'vm-uuid': 'bc37cbdb-1665-41de-bac9-b7fcf976c048'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:09 user nova-compute[82009]: INFO os_vif [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61')
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:22:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No VIF found with MAC fa:16:3e:81:7b:39, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "bfd52279-f440-48cb-9c97-8133c7322482" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:10 user nova-compute[82009]: INFO nova.compute.manager [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Terminating instance
Apr 11 18:22:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Updated VIF entry in instance network info cache for port 3d6e7b56-6149-4e34-8c82-9aa71a2d73db. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Updating instance_info_cache with network_info: [{"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d8a45963-ccac-4b0b-97e1-d6644a79235e req-75fe67b0-9162-4957-8c21-6cc35c60b0a1 service nova] Releasing lock "refresh_cache-bc37cbdb-1665-41de-bac9-b7fcf976c048" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-vif-unplugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] No waiting events found dispatching network-vif-unplugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-222d6647-4755-46f5-aaaa-5bdad4cbc325 req-e6dc6497-8760-471b-b887-269185c324b1 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-vif-unplugged-8db65a44-6cb3-4c5e-b180-49709126b545 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:22:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Instance destroyed successfully.
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'resources' on Instance uuid bfd52279-f440-48cb-9c97-8133c7322482 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720236868',display_name='tempest-TestVolumeBootPattern-server-720236868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-720236868',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:20:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-di0d09x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:20:35Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=bfd52279-f440-48cb-9c97-8133c7322482,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "8db65a44-6cb3-4c5e-b180-49709126b545", "address": "fa:16:3e:32:70:f3", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8db65a44-6c", "ovs_interfaceid": "8db65a44-6cb3-4c5e-b180-49709126b545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_vif [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8db65a44-6c, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:11 user nova-compute[82009]: INFO os_vif [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:70:f3,bridge_name='br-int',has_traffic_filtering=True,id=8db65a44-6cb3-4c5e-b180-49709126b545,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8db65a44-6c')
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VEYCuxWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:22:11 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[da26e169-26df-4fba-b818-a7f819a8e0cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:22:11 user nova-compute[82009]: No targets found.
Apr 11 18:22:11 user nova-compute[82009]: iSNS:
Apr 11 18:22:11 user nova-compute[82009]: No targets found.
Apr 11 18:22:11 user nova-compute[82009]: STATIC:
Apr 11 18:22:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:22:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:22:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:22:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1
Apr 11 18:22:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:22:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:22:11 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:22:11 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:22:11 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:22:11 user nova-compute[82009]: FIRMWARE:
Apr 11 18:22:11 user nova-compute[82009]: No targets found.
Apr 11 18:22:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:22:11 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:22:11 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4efbee-f49c-44cb-8ecf-55a20bbfb1a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e4d6be-708e-4d44-b79b-f82042dcfe46]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:22:11 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:22:11 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:22:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:22:11 user nova-compute[82009]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 (non-flash)
Apr 11 18:22:11 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:22:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c02b48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1'): ({'sdg'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Removing single pathed devices sdg {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4815a6f-c64a-49fd-9f59-d3d7b504faae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[588da718-a614-47b9-b326-9f140cd9e21f]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flushing IO for device /dev/sdg {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30920fe-cc96-4ad3-a8e5-383caf20fd4f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] No waiting events found dispatching network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:11 user nova-compute[82009]: WARNING nova.compute.manager [req-ceccd977-c552-4920-88f9-3f50c50d4fed req-9491b657-1792-49a2-adb6-56d7ac2a57a1 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received unexpected event network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance with vm_state building and task_state spawning.
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f10322-7e34-41d6-af4a-73972580f115]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] SCSI volumes sdg have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b1be14-9987-4213-8e76-a9c5b4796cf4]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda2b2ee-3330-4d42-8ffa-9e37b51caa68]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260]
Apr 11 18:22:11 user nova-compute[82009]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1, portal: 172.16.0.220,3260] successful.
Apr 11 18:22:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee215f7-2a29-4b25-b6bc-73e4d67670a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc64446-e710-48f2-b2b9-b2f04815d3d1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== disconnect_volume: return (332ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:22:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Deleting instance files /opt/stack/data/nova/instances/bfd52279-f440-48cb-9c97-8133c7322482_del
Apr 11 18:22:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Deletion of /opt/stack/data/nova/instances/bfd52279-f440-48cb-9c97-8133c7322482_del complete
Apr 11 18:22:11 user nova-compute[82009]: INFO nova.compute.manager [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Took 1.68 seconds to destroy the instance on the hypervisor.
Apr 11 18:22:11 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:22:11 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:12 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Took 0.47 seconds to deallocate network for instance.
Apr 11 18:22:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-vif-deleted-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:12 user nova-compute[82009]: INFO nova.compute.manager [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Neutron deleted interface 8db65a44-6cb3-4c5e-b180-49709126b545; detaching it from the instance and deleting it from the info cache
Apr 11 18:22:12 user nova-compute[82009]: DEBUG nova.network.neutron [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-7678412e-38e7-4075-bbf3-8e2dbef0807e req-78f7ac4d-974e-46df-a639-2c322503bb40 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Detach interface failed, port_id=8db65a44-6cb3-4c5e-b180-49709126b545, reason: Instance bfd52279-f440-48cb-9c97-8133c7322482 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received event network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Acquiring lock "bfd52279-f440-48cb-9c97-8133c7322482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] Lock "bfd52279-f440-48cb-9c97-8133c7322482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] No waiting events found dispatching network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:12 user nova-compute[82009]: WARNING nova.compute.manager [req-f58f25e7-e446-46b3-aae4-6b86b5f3e6cd req-08e2cdb0-92d5-46b0-a736-1aba861fdec2 service nova] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Received unexpected event network-vif-plugged-8db65a44-6cb3-4c5e-b180-49709126b545 for instance with vm_state active and task_state deleting.
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Deleting volume: 7ee215f7-2a29-4b25-b6bc-73e4d67670a1 {{(pid=82009) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Deleted allocations for instance bfd52279-f440-48cb-9c97-8133c7322482
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237333.4994817, bc37cbdb-1665-41de-bac9-b7fcf976c048 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] VM Resumed (Lifecycle Event)
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Instance spawned successfully.
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237333.5029643, bc37cbdb-1665-41de-bac9-b7fcf976c048 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] VM Started (Lifecycle Event)
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-19adb5e8-51c8-4a1c-a2b5-80efda35916e tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "bfd52279-f440-48cb-9c97-8133c7322482" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.442s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] No waiting events found dispatching network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:13 user nova-compute[82009]: WARNING nova.compute.manager [req-4518cdfa-56ef-40de-bb1d-6119b5d2e042 req-4fb5b4e7-3291-43ba-a70c-26a9eb4e6c8a service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received unexpected event network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance with vm_state building and task_state spawning.
Apr 11 18:22:13 user nova-compute[82009]: INFO nova.compute.manager [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Took 6.74 seconds to build instance.
Apr 11 18:22:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-15c25b43-ebaf-4d86-85ef-f4ac8e7bc17b tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.863s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:16 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237321.8269517, 91bf5195-b2bc-48ca-9632-5ae616090fd2 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:16 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] VM Stopped (Lifecycle Event)
Apr 11 18:22:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-eae008fa-f26f-4e09-8343-758b5caabe18 None None] [instance: 91bf5195-b2bc-48ca-9632-5ae616090fd2] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:19 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237323.766796, 7296c02e-f468-45b9-b037-e6cd240dd27d => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:19 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] VM Stopped (Lifecycle Event)
Apr 11 18:22:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-afd53e24-a10e-4e8f-99e5-a94959b67355 None None] [instance: 7296c02e-f468-45b9-b037-e6cd240dd27d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:21 user nova-compute[82009]: INFO nova.compute.manager [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Unrescuing
Apr 11 18:22:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:22:22 user nova-compute[82009]: DEBUG nova.network.neutron [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:23 user nova-compute[82009]: WARNING nova.compute.manager [req-7ad317ff-93f4-4451-83e3-96dc29b20ae9 req-93383aff-b4aa-4bc3-8a2b-f1ed4df0a534 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:22:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance destroyed successfully.
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:22:23 user nova-compute[82009]: INFO nova.compute.claims [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Claim successful on node user
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:22:23 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:22:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.policy [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b724859b7dcd4fd29f17bbf991e9f6d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed92c60cf9644b5ba5cefd2e92df3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:22:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Creating image(s)
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk 1073741824" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Cannot resize image /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'migration_context' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Ensure instance console log exists: /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Successfully created port: 480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:25 user nova-compute[82009]: WARNING nova.compute.manager [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:25 user nova-compute[82009]: WARNING nova.compute.manager [req-aec21b8f-b2c7-4374-8e67-37384cc45fab req-d72eb530-7c01-4519-b36c-47f1aec5b24b service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Successfully updated port: 480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing instance network info cache due to event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.neutron [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance network_info: |[{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Start _get_guest_xml network_info=[{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:22:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891122104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891122104',id=29,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4UT1jM+S2X9MyxQqF+Oy/72JleNBxRkmuHwrvJGSFpmjQkv23wckhLJZtjOdqaJJ0Z7NI49IR6xFA4+Vc5wRw9Eh60mBoafHGjPt+olG1clsJEASk4rQXvE+RJNyQ5AQ==',key_name='tempest-keypair-1067458808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-ejbm95nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=17ecc1bd-12b1-4834-989b-607cf2eb41e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'pci_devices' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:22:26 user nova-compute[82009]:   <uuid>17ecc1bd-12b1-4834-989b-607cf2eb41e6</uuid>
Apr 11 18:22:26 user nova-compute[82009]:   <name>instance-0000001d</name>
Apr 11 18:22:26 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:22:26 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:22:26 user nova-compute[82009]:   <metadata>
Apr 11 18:22:26 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:22:26 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:22:26 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1891122104</nova:name>
Apr 11 18:22:26 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:22:26</nova:creationTime>
Apr 11 18:22:26 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:22:26 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:22:26 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:22:26 user nova-compute[82009]:       <nova:owner>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:user uuid="b724859b7dcd4fd29f17bbf991e9f6d4">tempest-AttachVolumeShelveTestJSON-93672654-project-member</nova:user>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:project uuid="0ed92c60cf9644b5ba5cefd2e92df3e0">tempest-AttachVolumeShelveTestJSON-93672654</nova:project>
Apr 11 18:22:26 user nova-compute[82009]:       </nova:owner>
Apr 11 18:22:26 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:22:26 user nova-compute[82009]:       <nova:ports>
Apr 11 18:22:26 user nova-compute[82009]:         <nova:port uuid="480464a5-6cf9-4a50-b936-059cceecb02d">
Apr 11 18:22:26 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:22:26 user nova-compute[82009]:         </nova:port>
Apr 11 18:22:26 user nova-compute[82009]:       </nova:ports>
Apr 11 18:22:26 user nova-compute[82009]:     </nova:instance>
Apr 11 18:22:26 user nova-compute[82009]:   </metadata>
Apr 11 18:22:26 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:22:26 user nova-compute[82009]:     <system>
Apr 11 18:22:26 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:22:26 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:22:26 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:22:26 user nova-compute[82009]:       <entry name="serial">17ecc1bd-12b1-4834-989b-607cf2eb41e6</entry>
Apr 11 18:22:26 user nova-compute[82009]:       <entry name="uuid">17ecc1bd-12b1-4834-989b-607cf2eb41e6</entry>
Apr 11 18:22:26 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:22:26 user nova-compute[82009]:     </system>
Apr 11 18:22:26 user nova-compute[82009]:   </sysinfo>
Apr 11 18:22:26 user nova-compute[82009]:   <os>
Apr 11 18:22:26 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:22:26 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:22:26 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:22:26 user nova-compute[82009]:   </os>
Apr 11 18:22:26 user nova-compute[82009]:   <features>
Apr 11 18:22:26 user nova-compute[82009]:     <acpi/>
Apr 11 18:22:26 user nova-compute[82009]:     <apic/>
Apr 11 18:22:26 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:22:26 user nova-compute[82009]:   </features>
Apr 11 18:22:26 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:22:26 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:22:26 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:22:26 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:22:26 user nova-compute[82009]:   </clock>
Apr 11 18:22:26 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:22:26 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:22:26 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:22:26 user nova-compute[82009]:   </cpu>
Apr 11 18:22:26 user nova-compute[82009]:   <devices>
Apr 11 18:22:26 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:22:26 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:22:26 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk"/>
Apr 11 18:22:26 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:22:26 user nova-compute[82009]:     </disk>
Apr 11 18:22:26 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:22:26 user nova-compute[82009]:       <mac address="fa:16:3e:5e:7d:dc"/>
Apr 11 18:22:26 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:22:26 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:22:26 user nova-compute[82009]:       <target dev="tap480464a5-6c"/>
Apr 11 18:22:26 user nova-compute[82009]:     </interface>
Apr 11 18:22:26 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:22:26 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/console.log" append="off"/>
Apr 11 18:22:26 user nova-compute[82009]:     </serial>
Apr 11 18:22:26 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:22:26 user nova-compute[82009]:     <video>
Apr 11 18:22:26 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:22:26 user nova-compute[82009]:     </video>
Apr 11 18:22:26 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:22:26 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:22:26 user nova-compute[82009]:     </rng>
Apr 11 18:22:26 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:22:26 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:22:26 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:22:26 user nova-compute[82009]:     </memballoon>
Apr 11 18:22:26 user nova-compute[82009]:   </devices>
Apr 11 18:22:26 user nova-compute[82009]: </domain>
Apr 11 18:22:26 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891122104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891122104',id=29,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4UT1jM+S2X9MyxQqF+Oy/72JleNBxRkmuHwrvJGSFpmjQkv23wckhLJZtjOdqaJJ0Z7NI49IR6xFA4+Vc5wRw9Eh60mBoafHGjPt+olG1clsJEASk4rQXvE+RJNyQ5AQ==',key_name='tempest-keypair-1067458808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-ejbm95nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=17ecc1bd-12b1-4834-989b-607cf2eb41e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG os_vif [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap480464a5-6c, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap480464a5-6c, col_values=(('external_ids', {'iface-id': '480464a5-6cf9-4a50-b936-059cceecb02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:7d:dc', 'vm-uuid': '17ecc1bd-12b1-4834-989b-607cf2eb41e6'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:26 user nova-compute[82009]: INFO os_vif [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c')
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No VIF found with MAC fa:16:3e:5e:7d:dc, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237331.286605, bfd52279-f440-48cb-9c97-8133c7322482 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:26 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bfd52279-f440-48cb-9c97-8133c7322482] VM Stopped (Lifecycle Event)
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-94d573a0-6fdd-41db-a09e-a583609c2ec3 None None] [instance: bfd52279-f440-48cb-9c97-8133c7322482] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updated VIF entry in instance network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-973d8e3d-478a-4160-bdb7-fade5fd8d10f req-f7093e5f-5c64-473e-b02e-94079f854eb9 service nova] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for c5a2e113-75f7-47ac-bdf9-458793a62061 due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237347.0244331, c5a2e113-75f7-47ac-bdf9-458793a62061 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Resumed (Lifecycle Event)
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a932f4e1-b959-46ea-af7e-ad9ae4f0debd tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237347.0262136, c5a2e113-75f7-47ac-bdf9-458793a62061 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Started (Lifecycle Event)
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:27 user nova-compute[82009]: WARNING nova.compute.manager [req-b0078f23-01d3-4a2f-b601-d64efb96ee48 req-221a0618-8fe8-46e0-805a-378ed7ba83ba service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state active and task_state None.
Apr 11 18:22:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:27 user nova-compute[82009]: WARNING nova.compute.manager [req-daf31621-3e1c-4bce-8553-128fa2747321 req-41fbc6a4-5080-49c0-9f4c-c06a206188b8 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state building and task_state spawning.
Apr 11 18:22:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237349.7621932, 17ecc1bd-12b1-4834-989b-607cf2eb41e6 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] VM Resumed (Lifecycle Event)
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance spawned successfully.
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237349.766131, 17ecc1bd-12b1-4834-989b-607cf2eb41e6 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] VM Started (Lifecycle Event)
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Took 5.71 seconds to spawn the instance on the hypervisor.
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:29 user nova-compute[82009]: WARNING nova.compute.manager [req-c531bd92-3bc8-488e-8cef-9f9c9164892f req-a38fe01e-00ce-4c43-baeb-905fe539d0fa service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state building and task_state spawning.
Apr 11 18:22:29 user nova-compute[82009]: INFO nova.compute.manager [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Took 6.45 seconds to build instance.
Apr 11 18:22:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fd26462c-1efe-419f-a374-ca85a14930ba tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.574s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquired lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'info_cache' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Releasing lock "refresh_cache-e7908f28-28c2-4b9a-b804-042f0d186691" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:22:33 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance destroyed successfully.
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'resources' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG os_vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73d8e6ed-57, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:33 user nova-compute[82009]: INFO os_vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57')
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start _get_guest_xml network_info=[{"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'numa_topology' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:33 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:33 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'pci_devices' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:22:33 user nova-compute[82009]:   <uuid>e7908f28-28c2-4b9a-b804-042f0d186691</uuid>
Apr 11 18:22:33 user nova-compute[82009]:   <name>instance-00000011</name>
Apr 11 18:22:33 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:22:33 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:22:33 user nova-compute[82009]:   <metadata>
Apr 11 18:22:33 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:22:33 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:22:33 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeTestJSON-server-977045182</nova:name>
Apr 11 18:22:33 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:22:33</nova:creationTime>
Apr 11 18:22:33 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:22:33 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:22:33 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:22:33 user nova-compute[82009]:       <nova:owner>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:user uuid="b852c50aeb514b7fbe5a9b72e8bbdc14">tempest-AttachVolumeTestJSON-369540173-project-member</nova:user>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:project uuid="d77a56502d9848a3842c938d5adc8c51">tempest-AttachVolumeTestJSON-369540173</nova:project>
Apr 11 18:22:33 user nova-compute[82009]:       </nova:owner>
Apr 11 18:22:33 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:22:33 user nova-compute[82009]:       <nova:ports>
Apr 11 18:22:33 user nova-compute[82009]:         <nova:port uuid="73d8e6ed-570b-444e-a062-22d66314138a">
Apr 11 18:22:33 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:22:33 user nova-compute[82009]:         </nova:port>
Apr 11 18:22:33 user nova-compute[82009]:       </nova:ports>
Apr 11 18:22:33 user nova-compute[82009]:     </nova:instance>
Apr 11 18:22:33 user nova-compute[82009]:   </metadata>
Apr 11 18:22:33 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:22:33 user nova-compute[82009]:     <system>
Apr 11 18:22:33 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:22:33 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:22:33 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:22:33 user nova-compute[82009]:       <entry name="serial">e7908f28-28c2-4b9a-b804-042f0d186691</entry>
Apr 11 18:22:33 user nova-compute[82009]:       <entry name="uuid">e7908f28-28c2-4b9a-b804-042f0d186691</entry>
Apr 11 18:22:33 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:22:33 user nova-compute[82009]:     </system>
Apr 11 18:22:33 user nova-compute[82009]:   </sysinfo>
Apr 11 18:22:33 user nova-compute[82009]:   <os>
Apr 11 18:22:33 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:22:33 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:22:33 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:22:33 user nova-compute[82009]:   </os>
Apr 11 18:22:33 user nova-compute[82009]:   <features>
Apr 11 18:22:33 user nova-compute[82009]:     <acpi/>
Apr 11 18:22:33 user nova-compute[82009]:     <apic/>
Apr 11 18:22:33 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:22:33 user nova-compute[82009]:   </features>
Apr 11 18:22:33 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:22:33 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:22:33 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:22:33 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:22:33 user nova-compute[82009]:   </clock>
Apr 11 18:22:33 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:22:33 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:22:33 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:22:33 user nova-compute[82009]:   </cpu>
Apr 11 18:22:33 user nova-compute[82009]:   <devices>
Apr 11 18:22:33 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:22:33 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:22:33 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk"/>
Apr 11 18:22:33 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:22:33 user nova-compute[82009]:     </disk>
Apr 11 18:22:33 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:22:33 user nova-compute[82009]:       <mac address="fa:16:3e:8b:69:25"/>
Apr 11 18:22:33 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:22:33 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:22:33 user nova-compute[82009]:       <target dev="tap73d8e6ed-57"/>
Apr 11 18:22:33 user nova-compute[82009]:     </interface>
Apr 11 18:22:33 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:22:33 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/console.log" append="off"/>
Apr 11 18:22:33 user nova-compute[82009]:     </serial>
Apr 11 18:22:33 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:22:33 user nova-compute[82009]:     <video>
Apr 11 18:22:33 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:22:33 user nova-compute[82009]:     </video>
Apr 11 18:22:33 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:22:33 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:22:33 user nova-compute[82009]:     </rng>
Apr 11 18:22:33 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:22:33 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:22:33 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:22:33 user nova-compute[82009]:     </memballoon>
Apr 11 18:22:33 user nova-compute[82009]:   </devices>
Apr 11 18:22:33 user nova-compute[82009]: </domain>
Apr 11 18:22:33 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:22:33 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Cannot resize image /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.objects.instance [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'migration_context' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG os_vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73d8e6ed-57, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73d8e6ed-57, col_values=(('external_ids', {'iface-id': '73d8e6ed-570b-444e-a062-22d66314138a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:69:25', 'vm-uuid': 'e7908f28-28c2-4b9a-b804-042f0d186691'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:22:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:34 user nova-compute[82009]: INFO os_vif [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57')
Apr 11 18:22:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG nova.compute.manager [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:36 user nova-compute[82009]: WARNING nova.compute.manager [req-8ddf0a48-443c-48a0-9ea7-d3415dfe4b76 req-076d2d36-c9ac-4732-b578-9db8c69b97a7 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state stopped and task_state powering-on.
Apr 11 18:22:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:36 user nova-compute[82009]: INFO nova.compute.manager [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] instance snapshotting
Apr 11 18:22:36 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Beginning live snapshot process
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json -f qcow2" returned: 0 in 0.128s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpga686ep8/30e2ac0ec55e402c81d4c5e152c22175.delta 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpga686ep8/30e2ac0ec55e402c81d4c5e152c22175.delta 1073741824" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:37 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:22:38 user nova-compute[82009]: WARNING nova.compute.manager [req-3e7bc476-060d-42b6-846f-dfacf6dac63e req-14db5982-fcf3-4eed-a197-50105c720117 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state stopped and task_state powering-on.
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237358.2200596, e7908f28-28c2-4b9a-b804-042f0d186691 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Resumed (Lifecycle Event)
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:22:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance rebooted successfully.
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-226977e5-66f5-4e90-846a-7da74114e5e3 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237358.221566, e7908f28-28c2-4b9a-b804-042f0d186691 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:22:38 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Started (Lifecycle Event)
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:22:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:22:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 18:22:39 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:22:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpga686ep8/30e2ac0ec55e402c81d4c5e152c22175.delta /opt/stack/data/nova/instances/snapshots/tmpga686ep8/30e2ac0ec55e402c81d4c5e152c22175 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:22:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpga686ep8/30e2ac0ec55e402c81d4c5e152c22175.delta /opt/stack/data/nova/instances/snapshots/tmpga686ep8/30e2ac0ec55e402c81d4c5e152c22175" returned: 0 in 0.508s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:22:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Snapshot extracted, beginning image upload
Apr 11 18:22:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Snapshot image upload complete
Apr 11 18:22:41 user nova-compute[82009]: INFO nova.compute.manager [None req-ded62cbe-333b-433f-bca2-027d987d469f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Took 4.87 seconds to snapshot the instance on the hypervisor.
Apr 11 18:22:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:22:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:22:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [{"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-1adc9f1d-cc32-446e-9ffc-5fada2383164" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:00 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:23:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:23:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7675MB free_disk=26.348018646240234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 1adc9f1d-cc32-446e-9ffc-5fada2383164 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:23:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:23:05 user nova-compute[82009]: INFO nova.compute.claims [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Claim successful on node user
Apr 11 18:23:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:23:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:23:06 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:23:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG nova.policy [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:23:06 user nova-compute[82009]: INFO nova.virt.block_device [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Booting with volume 94331799-c0ed-4258-962d-d21d01e8de14 at /dev/vda
Apr 11 18:23:06 user nova-compute[82009]: DEBUG os_brick.utils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8450a41b-edb2-4519-87ed-bc03d0d8784b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a88c847-9c7a-4696-a244-6ead4f613f86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f3200-3b59-40f6-87ca-d401bb75742d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c357a5cd-34c6-4005-8d2d-267a153528a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:23:06 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:23:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f91aa-6c6d-4ce0-be1d-dbaa797314c5]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG os_brick.utils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:23:06 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Updating existing volume attachment record: 48a6199a-d3a8-42c9-8b3e-e885cfc42a92 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Successfully created port: 1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:23:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Successfully updated port: 1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "refresh_cache-88a15a03-3576-4b80-a11d-f7fd838429e9" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquired lock "refresh_cache-88a15a03-3576-4b80-a11d-f7fd838429e9" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-changed-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.compute.manager [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Refreshing instance network info cache due to event network-changed-1f623093-dd91-4d96-b18d-81470e690172. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Acquiring lock "refresh_cache-88a15a03-3576-4b80-a11d-f7fd838429e9" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Updating instance_info_cache with network_info: [{"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Releasing lock "refresh_cache-88a15a03-3576-4b80-a11d-f7fd838429e9" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Instance network_info: |[{"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Acquired lock "refresh_cache-88a15a03-3576-4b80-a11d-f7fd838429e9" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:23:08 user nova-compute[82009]: DEBUG nova.network.neutron [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Refreshing network info cache for port 1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:23:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Updated VIF entry in instance network info cache for port 1f623093-dd91-4d96-b18d-81470e690172. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:23:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Updating instance_info_cache with network_info: [{"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:23:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0adc1fcf-028e-429e-8496-cc9dc1325a82 req-670094d6-da51-4ca4-94b4-e2b672b7390f service nova] Releasing lock "refresh_cache-88a15a03-3576-4b80-a11d-f7fd838429e9" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:23:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:23:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Creating image(s)
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Ensure instance console log exists: /opt/stack/data/nova/instances/88a15a03-3576-4b80-a11d-f7fd838429e9/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Start _get_guest_xml network_info=[{"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '48a6199a-d3a8-42c9-8b3e-e885cfc42a92', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlUqJsSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88a15a03-3576-4b80-a11d-f7fd838429e9', 'attached_at': '', 'detached_at': '', 'volume_id': '94331799-c0ed-4258-962d-d21d01e8de14', 'serial': '94331799-c0ed-4258-962d-d21d01e8de14'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:23:10 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:23:10 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlUqJsSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:23:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:23:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:23:10 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacce082-f41f-43ce-914c-d46e627aaf2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:23:10 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[227529a1-cefc-46c7-b364-3e5ae556118d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14] added
Apr 11 18:23:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bad6b2-aae5-4b05-80ec-353050f47f59]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475f7a1-0f2d-41c3-a870-4e9d25db5485]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlUqJsSk {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlUqJsSk" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66800c3-7a3e-48e0-83f6-89a8174c41b9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlUqJsSk'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c1136-f7b3-4879-a5c8-f9aa50eb59d6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de394475-d65a-4d18-b517-492c28beaf4d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:10 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:23:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:10 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:23:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3b4cf-ae39-4aff-a194-d712ed562b6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260]
Apr 11 18:23:10 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260] successful.
Apr 11 18:23:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf541b5-0bca-48df-8207-d3ae0e71b8d2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e859fd72-751f-4467-963e-c4a2ce611342]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:11 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:23:11 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:11 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:23:11 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997e5c5-b4e4-45a0-bb17-47d6dd97ad4e]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlUqJsSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26566666332663261', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566666332663261', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2036153281',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2036153281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2036153281',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-atoed6r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:23:06Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=88a15a03-3576-4b80-a11d-f7fd838429e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'pci_devices' on Instance uuid 88a15a03-3576-4b80-a11d-f7fd838429e9 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:23:12 user nova-compute[82009]:   <uuid>88a15a03-3576-4b80-a11d-f7fd838429e9</uuid>
Apr 11 18:23:12 user nova-compute[82009]:   <name>instance-0000001e</name>
Apr 11 18:23:12 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:23:12 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:23:12 user nova-compute[82009]:   <metadata>
Apr 11 18:23:12 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:23:12 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:23:12 user nova-compute[82009]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2036153281</nova:name>
Apr 11 18:23:12 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:23:10</nova:creationTime>
Apr 11 18:23:12 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:23:12 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:23:12 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:23:12 user nova-compute[82009]:       <nova:owner>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:user uuid="4c8825bcd5894c999412499de320dc00">tempest-TestVolumeBootPattern-1768143130-project-member</nova:user>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:project uuid="e4f6857b777f4207b93d8c28aa39054b">tempest-TestVolumeBootPattern-1768143130</nova:project>
Apr 11 18:23:12 user nova-compute[82009]:       </nova:owner>
Apr 11 18:23:12 user nova-compute[82009]:       <nova:ports>
Apr 11 18:23:12 user nova-compute[82009]:         <nova:port uuid="1f623093-dd91-4d96-b18d-81470e690172">
Apr 11 18:23:12 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 18:23:12 user nova-compute[82009]:         </nova:port>
Apr 11 18:23:12 user nova-compute[82009]:       </nova:ports>
Apr 11 18:23:12 user nova-compute[82009]:     </nova:instance>
Apr 11 18:23:12 user nova-compute[82009]:   </metadata>
Apr 11 18:23:12 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:23:12 user nova-compute[82009]:     <system>
Apr 11 18:23:12 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:23:12 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:23:12 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:23:12 user nova-compute[82009]:       <entry name="serial">88a15a03-3576-4b80-a11d-f7fd838429e9</entry>
Apr 11 18:23:12 user nova-compute[82009]:       <entry name="uuid">88a15a03-3576-4b80-a11d-f7fd838429e9</entry>
Apr 11 18:23:12 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:23:12 user nova-compute[82009]:     </system>
Apr 11 18:23:12 user nova-compute[82009]:   </sysinfo>
Apr 11 18:23:12 user nova-compute[82009]:   <os>
Apr 11 18:23:12 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:23:12 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:23:12 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:23:12 user nova-compute[82009]:   </os>
Apr 11 18:23:12 user nova-compute[82009]:   <features>
Apr 11 18:23:12 user nova-compute[82009]:     <acpi/>
Apr 11 18:23:12 user nova-compute[82009]:     <apic/>
Apr 11 18:23:12 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:23:12 user nova-compute[82009]:   </features>
Apr 11 18:23:12 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:23:12 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:23:12 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:23:12 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:23:12 user nova-compute[82009]:   </clock>
Apr 11 18:23:12 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:23:12 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:23:12 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:23:12 user nova-compute[82009]:   </cpu>
Apr 11 18:23:12 user nova-compute[82009]:   <devices>
Apr 11 18:23:12 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:23:12 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:23:12 user nova-compute[82009]:       <source dev="/dev/sdb"/>
Apr 11 18:23:12 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:23:12 user nova-compute[82009]:       <serial>94331799-c0ed-4258-962d-d21d01e8de14</serial>
Apr 11 18:23:12 user nova-compute[82009]:     </disk>
Apr 11 18:23:12 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:23:12 user nova-compute[82009]:       <mac address="fa:16:3e:e9:3d:ee"/>
Apr 11 18:23:12 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:23:12 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:23:12 user nova-compute[82009]:       <target dev="tap1f623093-dd"/>
Apr 11 18:23:12 user nova-compute[82009]:     </interface>
Apr 11 18:23:12 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:23:12 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/88a15a03-3576-4b80-a11d-f7fd838429e9/console.log" append="off"/>
Apr 11 18:23:12 user nova-compute[82009]:     </serial>
Apr 11 18:23:12 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:23:12 user nova-compute[82009]:     <video>
Apr 11 18:23:12 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:23:12 user nova-compute[82009]:     </video>
Apr 11 18:23:12 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:23:12 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:23:12 user nova-compute[82009]:     </rng>
Apr 11 18:23:12 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:23:12 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:23:12 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:23:12 user nova-compute[82009]:     </memballoon>
Apr 11 18:23:12 user nova-compute[82009]:   </devices>
Apr 11 18:23:12 user nova-compute[82009]: </domain>
Apr 11 18:23:12 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2036153281',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2036153281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2036153281',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-atoed6r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:23:06Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=88a15a03-3576-4b80-a11d-f7fd838429e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG os_vif [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f623093-dd, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f623093-dd, col_values=(('external_ids', {'iface-id': '1f623093-dd91-4d96-b18d-81470e690172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:3d:ee', 'vm-uuid': '88a15a03-3576-4b80-a11d-f7fd838429e9'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:12 user nova-compute[82009]: INFO os_vif [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd')
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No VIF found with MAC fa:16:3e:e9:3d:ee, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:23:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] No waiting events found dispatching network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:23:13 user nova-compute[82009]: WARNING nova.compute.manager [req-a7c02230-2d7d-4eb0-9b36-e147ead0eb7d req-7cda9a39-9cd7-4f95-8510-2c13de97e7a4 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received unexpected event network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 for instance with vm_state building and task_state spawning.
Apr 11 18:23:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237395.5468335, 88a15a03-3576-4b80-a11d-f7fd838429e9 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] VM Resumed (Lifecycle Event)
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Instance spawned successfully.
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237395.5506532, 88a15a03-3576-4b80-a11d-f7fd838429e9 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] VM Started (Lifecycle Event)
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Took 4.95 seconds to spawn the instance on the hypervisor.
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:23:15 user nova-compute[82009]: INFO nova.compute.manager [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Took 10.16 seconds to build instance.
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] No waiting events found dispatching network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:23:15 user nova-compute[82009]: WARNING nova.compute.manager [req-5a240218-20cb-4673-8005-5f40c24b2028 req-d1b08421-41c8-44a9-8104-4b2aa93a76e4 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received unexpected event network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 for instance with vm_state active and task_state None.
Apr 11 18:23:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b09378f4-aa44-4dfe-930a-f946d3e5f113 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.300s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:23:43 user nova-compute[82009]: INFO nova.compute.claims [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Claim successful on node user
Apr 11 18:23:43 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:23:44 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:23:44 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:23:44 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:23:44 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:23:44 user nova-compute[82009]: INFO nova.virt.block_device [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Booting with blank volume at /dev/vda
Apr 11 18:23:44 user nova-compute[82009]: DEBUG nova.policy [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:23:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:44 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Successfully created port: d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:45 user nova-compute[82009]: INFO nova.compute.manager [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Terminating instance
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Successfully updated port: d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-changed-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Refreshing instance network info cache due to event network-changed-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:23:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-e757c282-d6a2-4453-a681-b162d064f975 req-4ff20cba-adbb-426b-b0b3-99d912f9650c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-unplugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance network_info: |[{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.neutron [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Refreshing network info cache for port d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:23:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Instance destroyed successfully.
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid 1adc9f1d-cc32-446e-9ffc-5fada2383164 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1599225915',display_name='tempest-ServerActionsTestJSON-server-731201773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1599225915',id=6,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-c4emaj0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=1adc9f1d-cc32-446e-9ffc-5fada2383164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "98cc8035-8d3e-47cf-9758-c7172120ac70", "address": "fa:16:3e:fd:e3:b5", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cc8035-8d", "ovs_interfaceid": "98cc8035-8d3e-47cf-9758-c7172120ac70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_vif [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cc8035-8d, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:23:46 user nova-compute[82009]: INFO os_vif [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:b5,bridge_name='br-int',has_traffic_filtering=True,id=98cc8035-8d3e-47cf-9758-c7172120ac70,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cc8035-8d')
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyCaJwWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:23:46 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae4fdaa-3796-42c8-aa1e-a5ad8fbbb119]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:23:46 user nova-compute[82009]: No targets found.
Apr 11 18:23:46 user nova-compute[82009]: iSNS:
Apr 11 18:23:46 user nova-compute[82009]: No targets found.
Apr 11 18:23:46 user nova-compute[82009]: STATIC:
Apr 11 18:23:46 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a
Apr 11 18:23:46 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:23:46 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:23:46 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:23:46 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:23:46 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:23:46 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:23:46 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:23:46 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:23:46 user nova-compute[82009]: FIRMWARE:
Apr 11 18:23:46 user nova-compute[82009]: No targets found.
Apr 11 18:23:46 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:23:46 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:23:46 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b95385e-b79a-4f65-95a4-0460feed8bb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d9580-93fc-4bc4-bcdf-45c2df8de57f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:46 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:23:46 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:46 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:46 user nova-compute[82009]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a (non-flash)
Apr 11 18:23:46 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:46 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e15679a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9037641c-ae03-4c96-83d0-1790be46e05e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5470ddee-963e-43f4-ba70-0af0e70e3d4f]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.neutron [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updated VIF entry in instance network info cache for port d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.neutron [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c4294a-6ddf-4cb6-b790-ed1ef80a2e29]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9503c7bb-2867-41d0-829e-af65825bae49 req-4cf3ab93-e366-49b4-84dd-872e52fc3e81 service nova] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[07211a4d-5106-4590-84a3-09985efc7614]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e06198b-f99d-4e3c-b7b1-5b39bec3af06]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[173981f8-b790-4f40-bd3c-6ef3abfffc8e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260]
Apr 11 18:23:46 user nova-compute[82009]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a, portal: 172.16.0.220,3260] successful.
Apr 11 18:23:46 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314d5532-2e55-4c33-84fc-47a99b78f74a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8ebdb-3a23-48a3-be38-2930e412c9d2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (296ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:23:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Deleting instance files /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_del
Apr 11 18:23:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Deletion of /opt/stack/data/nova/instances/1adc9f1d-cc32-446e-9ffc-5fada2383164_del complete
Apr 11 18:23:46 user nova-compute[82009]: INFO nova.compute.manager [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 18:23:46 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:23:46 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:23:47 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Took 0.82 seconds to deallocate network for instance.
Apr 11 18:23:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-dea0962e-9917-4229-b898-47ac3058f795 req-c52291c0-c164-4a35-8b47-4173bcd70db4 service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-deleted-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Acquiring lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] No waiting events found dispatching network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:23:47 user nova-compute[82009]: WARNING nova.compute.manager [req-ff16f315-f6b1-4d1a-bd78-3bfd7015bc14 req-ba3f4a06-f07e-4ca6-a641-6b49b9bcfa0c service nova] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Received unexpected event network-vif-plugged-98cc8035-8d3e-47cf-9758-c7172120ac70 for instance with vm_state active and task_state deleting.
Apr 11 18:23:48 user nova-compute[82009]: INFO nova.compute.manager [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 18:23:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:48 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:23:48 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:23:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:48 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Deleted allocations for instance 1adc9f1d-cc32-446e-9ffc-5fada2383164
Apr 11 18:23:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c88305f8-666e-4d71-a242-ddaf1449f27f tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "1adc9f1d-cc32-446e-9ffc-5fada2383164" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.259s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG os_brick.utils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d043bcb-57dd-48fe-b66e-3ade0c0da3e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc1031-c2f3-41b7-bfa8-8920149287b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdf4572-d6e8-4411-9462-945829453954]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[19102f33-39fa-4eb9-99c8-42246ed4250e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:23:49 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:23:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[31470d7f-c518-4dc0-bc55-7f7373a4850e]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG os_brick.utils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:23:49 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating existing volume attachment record: 3cd66160-6b00-4eb3-b8ef-a3ccf0613cd8 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:23:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:23:54 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Creating image(s)
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Ensure instance console log exists: /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Start _get_guest_xml network_info=[{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cd66160-6b00-4eb3-b8ef-a3ccf0613cd8', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bef10824-ced0-49d5-934a-c509ab119cbf', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca57292f-f0c4-4b01-87ee-f7266c363937', 'serial': 'ca57292f-f0c4-4b01-87ee-f7266c363937'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:23:54 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:23:54 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:23:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:23:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:23:54 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f25b2-960a-4da4-bb9a-57d8f9568278]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:23:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c674d-7387-4638-b944-03e1a938d0a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937] added
Apr 11 18:23:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[213ca417-6409-4490-828f-b80b434e01cb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[583801b9-3d93-433a-a9bc-ac65f2397c7b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEQxHqeL {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEQxHqeL" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b089cd83-4438-4873-b2bd-4609290d437f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nEQxHqeL'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[978df7cc-3b37-416e-9d95-a67d2833caf8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[912db737-8911-468b-9c1d-38606ca3c11c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7de257-2973-49b0-a291-a22073408eed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260]
Apr 11 18:23:54 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260] successful.
Apr 11 18:23:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d2b9a-105b-494f-8e0a-7366e3cfbc6a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85058c77-ca3b-4f3e-a1fd-bedc70f5413f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:23:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0fc47d-de79-4b90-95d9-f41a05543669]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:23:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23036343033653765', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036343033653765', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1868063970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1868063970',id=31,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-n3t3bpyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:23:44Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=bef10824-ced0-49d5-934a-c509ab119cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'pci_devices' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:23:55 user nova-compute[82009]:   <uuid>bef10824-ced0-49d5-934a-c509ab119cbf</uuid>
Apr 11 18:23:55 user nova-compute[82009]:   <name>instance-0000001f</name>
Apr 11 18:23:55 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:23:55 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:23:55 user nova-compute[82009]:   <metadata>
Apr 11 18:23:55 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:23:55 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:23:55 user nova-compute[82009]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1868063970</nova:name>
Apr 11 18:23:55 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:23:54</nova:creationTime>
Apr 11 18:23:55 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:23:55 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:23:55 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:23:55 user nova-compute[82009]:       <nova:owner>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:user uuid="fde784625fda4447afc0b8e9bd0983a3">tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member</nova:user>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:project uuid="62a254c432f54e1b8735e40af7063506">tempest-ServerBootFromVolumeStableRescueTest-1689319261</nova:project>
Apr 11 18:23:55 user nova-compute[82009]:       </nova:owner>
Apr 11 18:23:55 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:23:55 user nova-compute[82009]:       <nova:ports>
Apr 11 18:23:55 user nova-compute[82009]:         <nova:port uuid="d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9">
Apr 11 18:23:55 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 18:23:55 user nova-compute[82009]:         </nova:port>
Apr 11 18:23:55 user nova-compute[82009]:       </nova:ports>
Apr 11 18:23:55 user nova-compute[82009]:     </nova:instance>
Apr 11 18:23:55 user nova-compute[82009]:   </metadata>
Apr 11 18:23:55 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:23:55 user nova-compute[82009]:     <system>
Apr 11 18:23:55 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:23:55 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:23:55 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:23:55 user nova-compute[82009]:       <entry name="serial">bef10824-ced0-49d5-934a-c509ab119cbf</entry>
Apr 11 18:23:55 user nova-compute[82009]:       <entry name="uuid">bef10824-ced0-49d5-934a-c509ab119cbf</entry>
Apr 11 18:23:55 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:23:55 user nova-compute[82009]:     </system>
Apr 11 18:23:55 user nova-compute[82009]:   </sysinfo>
Apr 11 18:23:55 user nova-compute[82009]:   <os>
Apr 11 18:23:55 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:23:55 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:23:55 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:23:55 user nova-compute[82009]:   </os>
Apr 11 18:23:55 user nova-compute[82009]:   <features>
Apr 11 18:23:55 user nova-compute[82009]:     <acpi/>
Apr 11 18:23:55 user nova-compute[82009]:     <apic/>
Apr 11 18:23:55 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:23:55 user nova-compute[82009]:   </features>
Apr 11 18:23:55 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:23:55 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:23:55 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:23:55 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:23:55 user nova-compute[82009]:   </clock>
Apr 11 18:23:55 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:23:55 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:23:55 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:23:55 user nova-compute[82009]:   </cpu>
Apr 11 18:23:55 user nova-compute[82009]:   <devices>
Apr 11 18:23:55 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:23:55 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:23:55 user nova-compute[82009]:       <source dev="/dev/sdc"/>
Apr 11 18:23:55 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:23:55 user nova-compute[82009]:       <serial>ca57292f-f0c4-4b01-87ee-f7266c363937</serial>
Apr 11 18:23:55 user nova-compute[82009]:     </disk>
Apr 11 18:23:55 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:23:55 user nova-compute[82009]:       <mac address="fa:16:3e:78:f3:ac"/>
Apr 11 18:23:55 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:23:55 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:23:55 user nova-compute[82009]:       <target dev="tapd2a4d7d0-fb"/>
Apr 11 18:23:55 user nova-compute[82009]:     </interface>
Apr 11 18:23:55 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:23:55 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/console.log" append="off"/>
Apr 11 18:23:55 user nova-compute[82009]:     </serial>
Apr 11 18:23:55 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:23:55 user nova-compute[82009]:     <video>
Apr 11 18:23:55 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:23:55 user nova-compute[82009]:     </video>
Apr 11 18:23:55 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:23:55 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:23:55 user nova-compute[82009]:     </rng>
Apr 11 18:23:55 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:23:55 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:23:55 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:23:55 user nova-compute[82009]:     </memballoon>
Apr 11 18:23:55 user nova-compute[82009]:   </devices>
Apr 11 18:23:55 user nova-compute[82009]: </domain>
Apr 11 18:23:55 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1868063970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1868063970',id=31,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-n3t3bpyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:23:44Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=bef10824-ced0-49d5-934a-c509ab119cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG os_vif [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a4d7d0-fb, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2a4d7d0-fb, col_values=(('external_ids', {'iface-id': 'd2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:f3:ac', 'vm-uuid': 'bef10824-ced0-49d5-934a-c509ab119cbf'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:55 user nova-compute[82009]: INFO os_vif [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb')
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:23:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No VIF found with MAC fa:16:3e:78:f3:ac, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:56 user nova-compute[82009]: DEBUG nova.compute.manager [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:23:56 user nova-compute[82009]: WARNING nova.compute.manager [req-176d9746-44d3-439d-8f71-2c37828f055b req-c849ca85-de24-423e-bec3-fdc6005f4fbc service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state building and task_state spawning.
Apr 11 18:23:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'flavor' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:23:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Ignoring supplied device name: /dev/vdb
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:57 user nova-compute[82009]: INFO nova.compute.manager [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Attaching volume 30422a52-74c1-4245-8cb1-8a363674796d to /dev/vdb
Apr 11 18:23:57 user nova-compute[82009]: DEBUG os_brick.utils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef3ab1-1373-4a5c-99d7-336bd84eea3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[79789f14-5a8b-4973-bd21-2665e33748e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f0a2fe-6378-4a74-8285-ad895c32568a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88fff72-bb02-427e-9520-d2ab99e9bdc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:23:57 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:23:57 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[130e1632-969b-4160-91f0-a6859bbfff65]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG os_brick.utils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:23:57 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Updating existing volume attachment record: b2b5b1a0-ff2f-4134-b7a8-d79bf2ef3a44 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237438.941059, bef10824-ced0-49d5-934a-c509ab119cbf => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:23:58 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Resumed (Lifecycle Event)
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:23:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance spawned successfully.
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:23:58 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:23:58 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237438.9433274, bef10824-ced0-49d5-934a-c509ab119cbf => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:23:58 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Started (Lifecycle Event)
Apr 11 18:23:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:23:59 user nova-compute[82009]: WARNING nova.compute.manager [req-949acaeb-266e-4763-91fe-d38387f8e513 req-c91e5d39-4a4b-4356-8328-e6b12a502cf5 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state building and task_state spawning.
Apr 11 18:23:59 user nova-compute[82009]: INFO nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Took 5.03 seconds to spawn the instance on the hypervisor.
Apr 11 18:23:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:23:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:23:59 user nova-compute[82009]: INFO nova.compute.manager [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Took 15.67 seconds to build instance.
Apr 11 18:23:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7dbfaa81-b7ca-4fcd-80af-35f4b69e7308 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.767s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:23:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:24:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237426.2899868, 1adc9f1d-cc32-446e-9ffc-5fada2383164 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:24:01 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] VM Stopped (Lifecycle Event)
Apr 11 18:24:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-41a7bb7e-c125-4b80-9b8e-9e74f4045a6d None None] [instance: 1adc9f1d-cc32-446e-9ffc-5fada2383164] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [{"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-253a1b67-06b0-4308-a2fc-78f36cda0ab8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxeNIbiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:24:01 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:24:01 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:24:01 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0077497d-8ebc-4e62-b824-182e0193d830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:24:01 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e7592-293b-448f-bac4-7c9a802d808d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d] added
Apr 11 18:24:01 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cad087-ff94-4ec8-9940-5e26eed2b6c3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f165069-c152-4353-8e33-f4caf98f6b34]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxeNIbiA {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxeNIbiA" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adfcf73-472c-4e1d-8e8d-7cea7f30534b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UxeNIbiA'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60158d5a-bd12-4716-b5e0-d229ead36bb7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c9edf2-be9d-4cdf-ad3a-ff6146ae61cf]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:01 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:01 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:01 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:01 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:01 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:01 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91df4ec-dff6-4d12-b6e6-97af3a29668d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260]
Apr 11 18:24:01 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260] successful.
Apr 11 18:24:01 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:01 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[52198df3-cd5c-44de-b1e8-e0e10d808908]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[08abf433-56e3-444b-9a48-2852caf7ec63]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:02 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:02 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:02 user nova-compute[82009]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d (non-flash)
Apr 11 18:24:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:02 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:02 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:02 user nova-compute[82009]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d (non-flash)
Apr 11 18:24:02 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3aa110-cc90-4e23-9d9f-86e49678c8d6]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxeNIbiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:02 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26266306238646235', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266306238646235', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG nova.objects.instance [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'flavor' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:24:03 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:24:03 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:24:03 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:24:03 user nova-compute[82009]:   <serial>30422a52-74c1-4245-8cb1-8a363674796d</serial>
Apr 11 18:24:03 user nova-compute[82009]: </disk>
Apr 11 18:24:03 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] No VIF found with MAC fa:16:3e:81:7b:39, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-152c8d8a-9d54-4d8d-a33e-a0c8e217add2 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.306s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:24:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:24:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:24:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7832MB free_disk=26.364330291748047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance e7908f28-28c2-4b9a-b804-042f0d186691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bc37cbdb-1665-41de-bac9-b7fcf976c048 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:24:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:24:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:09 user nova-compute[82009]: INFO nova.compute.manager [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Detaching volume 30422a52-74c1-4245-8cb1-8a363674796d
Apr 11 18:24:09 user nova-compute[82009]: INFO nova.virt.block_device [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Attempting to driver detach volume 30422a52-74c1-4245-8cb1-8a363674796d from mountpoint /dev/vdb
Apr 11 18:24:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Attempting to detach device vdb from instance bc37cbdb-1665-41de-bac9-b7fcf976c048 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:24:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:24:09 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:24:09 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:24:09 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:24:09 user nova-compute[82009]:   <serial>30422a52-74c1-4245-8cb1-8a363674796d</serial>
Apr 11 18:24:09 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:24:09 user nova-compute[82009]: </disk>
Apr 11 18:24:09 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:24:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully detached device vdb from instance bc37cbdb-1665-41de-bac9-b7fcf976c048 from the persistent domain config.
Apr 11 18:24:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc37cbdb-1665-41de-bac9-b7fcf976c048 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:24:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:24:09 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:24:09 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:24:09 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:24:09 user nova-compute[82009]:   <serial>30422a52-74c1-4245-8cb1-8a363674796d</serial>
Apr 11 18:24:09 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:24:09 user nova-compute[82009]: </disk>
Apr 11 18:24:09 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:24:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237450.352139, bc37cbdb-1665-41de-bac9-b7fcf976c048 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:24:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully detached device vdb from instance bc37cbdb-1665-41de-bac9-b7fcf976c048 from the live domain config.
Apr 11 18:24:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxeNIbiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:24:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e80da-9552-4e6b-bd96-023ac260e358]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:24:10 user nova-compute[82009]: No targets found.
Apr 11 18:24:10 user nova-compute[82009]: iSNS:
Apr 11 18:24:10 user nova-compute[82009]: No targets found.
Apr 11 18:24:10 user nova-compute[82009]: STATIC:
Apr 11 18:24:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:24:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d
Apr 11 18:24:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:24:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:24:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:10 user nova-compute[82009]: FIRMWARE:
Apr 11 18:24:10 user nova-compute[82009]: No targets found.
Apr 11 18:24:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:24:10 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:24:10 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2921508-e4b9-4c25-bd01-36a4a6e796cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73c3b3-6701-42bb-92c3-cb11707edbe4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:10 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:10 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:10 user nova-compute[82009]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d (non-flash)
Apr 11 18:24:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:10 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:10 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:10 user nova-compute[82009]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d (non-flash)
Apr 11 18:24:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6ce00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e592853c-5761-4f2d-830b-98c3231dfcae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da2ceb-3455-4c56-8001-a4788df0f401]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b4e982-285d-4724-83f5-258570d8ca00]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4650695-a301-457a-b709-3f885febdcfe]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33ca4ad-ed43-4776-a29e-5987d036b26e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a124a41a-4d7d-463b-8522-c54c6201294e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260]
Apr 11 18:24:10 user nova-compute[82009]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d, portal: 172.16.0.220,3260] successful.
Apr 11 18:24:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef41bca-867d-4a6f-abd6-0f6853615ac0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== disconnect_volume: return (305ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:24:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'flavor' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-58cfcabf-41b7-405c-ae92-ccffe602e8fa tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.620s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.504s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:11 user nova-compute[82009]: INFO nova.compute.manager [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Terminating instance
Apr 11 18:24:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-vif-unplugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] No waiting events found dispatching network-vif-unplugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-8fec7d26-158e-47d4-9cd8-89936c1b3d65 req-a9692d77-1702-4e59-bd58-c8019ce231cf service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-vif-unplugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:24:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Instance destroyed successfully.
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.objects.instance [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lazy-loading 'resources' on Instance uuid bc37cbdb-1665-41de-bac9-b7fcf976c048 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601205193',display_name='tempest-VolumesSnapshotTestJSON-instance-1601205193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601205193',id=28,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fde6ebc41bed44f1a04e23e62cd9ac0d',ramdisk_id='',reservation_id='r-06v6jsi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-251988417',owner_user_name='tempest-VolumesSnapshotTestJSON-251988417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:22:14Z,user_data=None,user_id='5fdf10ea561448f689cdd2d052080168',uuid=bc37cbdb-1665-41de-bac9-b7fcf976c048,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converting VIF {"id": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "address": "fa:16:3e:81:7b:39", "network": {"id": "63428a67-aad6-41c0-8022-1c7dbad79e7b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1864640431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fde6ebc41bed44f1a04e23e62cd9ac0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6e7b56-61", "ovs_interfaceid": "3d6e7b56-6149-4e34-8c82-9aa71a2d73db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_vif [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d6e7b56-61, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:12 user nova-compute[82009]: INFO os_vif [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:39,bridge_name='br-int',has_traffic_filtering=True,id=3d6e7b56-6149-4e34-8c82-9aa71a2d73db,network=Network(63428a67-aad6-41c0-8022-1c7dbad79e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6e7b56-61')
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxeNIbiA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:24:12 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed3b04-7816-4a11-ab12-cc04c67919b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:24:12 user nova-compute[82009]: No targets found.
Apr 11 18:24:12 user nova-compute[82009]: iSNS:
Apr 11 18:24:12 user nova-compute[82009]: No targets found.
Apr 11 18:24:12 user nova-compute[82009]: STATIC:
Apr 11 18:24:12 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:24:12 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:12 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:12 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:24:12 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:12 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:12 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:24:12 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:12 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:12 user nova-compute[82009]: FIRMWARE:
Apr 11 18:24:12 user nova-compute[82009]: No targets found.
Apr 11 18:24:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:24:12 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:24:12 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30422a52-74c1-4245-8cb1-8a363674796d', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37cc7f-2ba9-4be1-b7e3-f1de74819ce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593e147-dea7-45f5-9f93-c6885a75f11a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:12 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:12 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:12 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:12 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:12 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c02b5ab0>, {}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Disconnecting from: [] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] <== disconnect_volume: return (78ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:24:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Deleting instance files /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048_del
Apr 11 18:24:12 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Deletion of /opt/stack/data/nova/instances/bc37cbdb-1665-41de-bac9-b7fcf976c048_del complete
Apr 11 18:24:12 user nova-compute[82009]: INFO nova.compute.manager [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:12 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Took 0.54 seconds to deallocate network for instance.
Apr 11 18:24:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-625bb294-027b-4b54-8d3a-696757286232 req-d5d8dca5-6913-4a15-b4d3-e16307804b98 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-vif-deleted-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:12 user nova-compute[82009]: WARNING nova.volume.cinder [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Attachment b2b5b1a0-ff2f-4134-b7a8-d79bf2ef3a44 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b2b5b1a0-ff2f-4134-b7a8-d79bf2ef3a44. (HTTP 404) (Request-ID: req-80839280-7615-4182-8de2-c3190a5bffb7)
Apr 11 18:24:12 user nova-compute[82009]: INFO nova.compute.manager [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Took 0.03 seconds to detach 1 volumes for instance.
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing instance network info cache due to event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:13 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Deleted allocations for instance bc37cbdb-1665-41de-bac9-b7fcf976c048
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-2a8d942c-8539-45a8-affe-7970b66dbaf5 tempest-VolumesSnapshotTestJSON-251988417 tempest-VolumesSnapshotTestJSON-251988417-project-member] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.786s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:13 user nova-compute[82009]: INFO nova.compute.manager [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Detaching volume ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:24:13 user nova-compute[82009]: INFO nova.virt.block_device [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Attempting to driver detach volume ab2addce-fd37-48c2-be0e-131ebef2ce29 from mountpoint /dev/vdb
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Attempting to detach device vdb from instance c5a2e113-75f7-47ac-bdf9-458793a62061 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:24:13 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:24:13 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:24:13 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:24:13 user nova-compute[82009]:   <serial>ab2addce-fd37-48c2-be0e-131ebef2ce29</serial>
Apr 11 18:24:13 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:24:13 user nova-compute[82009]: </disk>
Apr 11 18:24:13 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:24:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully detached device vdb from instance c5a2e113-75f7-47ac-bdf9-458793a62061 from the persistent domain config.
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5a2e113-75f7-47ac-bdf9-458793a62061 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:24:13 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:24:13 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:24:13 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:24:13 user nova-compute[82009]:   <serial>ab2addce-fd37-48c2-be0e-131ebef2ce29</serial>
Apr 11 18:24:13 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:24:13 user nova-compute[82009]: </disk>
Apr 11 18:24:13 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received event network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Acquiring lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] Lock "bc37cbdb-1665-41de-bac9-b7fcf976c048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] No waiting events found dispatching network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:13 user nova-compute[82009]: WARNING nova.compute.manager [req-351314c7-cba0-4b4c-a89f-561463cc4f45 req-2a71f119-f7e5-42e1-8599-3278222923f7 service nova] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Received unexpected event network-vif-plugged-3d6e7b56-6149-4e34-8c82-9aa71a2d73db for instance with vm_state deleted and task_state None.
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237453.969662, c5a2e113-75f7-47ac-bdf9-458793a62061 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:24:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully detached device vdb from instance c5a2e113-75f7-47ac-bdf9-458793a62061 from the live domain config.
Apr 11 18:24:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sOdZFqVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:24:13 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:24:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:24:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746bafd-af89-4d64-9754-4217ea38c5f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:24:14 user nova-compute[82009]: No targets found.
Apr 11 18:24:14 user nova-compute[82009]: iSNS:
Apr 11 18:24:14 user nova-compute[82009]: No targets found.
Apr 11 18:24:14 user nova-compute[82009]: STATIC:
Apr 11 18:24:14 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:24:14 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:14 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:14 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:24:14 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:14 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:14 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29
Apr 11 18:24:14 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:24:14 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:24:14 user nova-compute[82009]: FIRMWARE:
Apr 11 18:24:14 user nova-compute[82009]: No targets found.
Apr 11 18:24:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:24:14 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:24:14 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d03db-db55-4b30-ba0f-1664d1ee9b93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[89982cc5-a117-499c-8b92-1e43049c148d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:14 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:14 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 (non-flash)
Apr 11 18:24:14 user nova-compute[82009]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:24:14 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:24:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6c21f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29'): ({'sdf'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Removing single pathed devices sdf {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75eb1c3-eddd-46ae-b827-79c3e2aeed94]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68999b86-66d3-4368-aefa-4b59a77688bb]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Flushing IO for device /dev/sdf {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c263c-fac0-4501-bcaf-2be0ae120521]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b8cde0-6777-454b-b2b8-56d086486520]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf4d7e-8c1c-485e-bd37-bbc5b1b06b3e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d161cd-78b1-400d-b04c-5350ef76c3a3]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260]
Apr 11 18:24:14 user nova-compute[82009]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29, portal: 172.16.0.220,3260] successful.
Apr 11 18:24:14 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2addce-fd37-48c2-be0e-131ebef2ce29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebb7806-7447-4f40-b801-b8f2ffbba289]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] <== disconnect_volume: return (285ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updated VIF entry in instance network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG nova.network.neutron [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-22872ea6-051c-4e8e-b6a1-50813edd29d0 req-c1423742-ba9f-4944-b887-b36acb33299c service nova] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing instance network info cache due to event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'flavor' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7a7fea15-703b-4e25-85b5-66892d152aee tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing instance network info cache due to event network-changed-2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Acquiring lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Acquired lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Refreshing network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updated VIF entry in instance network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-86a883d5-7b20-46b5-9400-bb0ff1f89e12 req-25bcb53b-4de0-4856-af42-74e7ced3f8a7 service nova] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updated VIF entry in instance network info cache for port 2de8f180-0b9b-405b-abcd-f44d2c15a437. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [{"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9898d88e-f3f4-4bb8-bc8b-6dddf4ed37e9 req-42821fd8-2a50-44eb-b67d-73e28a45b31d service nova] Releasing lock "refresh_cache-c5a2e113-75f7-47ac-bdf9-458793a62061" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:17 user nova-compute[82009]: INFO nova.compute.manager [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Shelving
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-unplugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-unplugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:17 user nova-compute[82009]: WARNING nova.compute.manager [req-d892c3d9-b33d-47e5-909b-bbc59479d94d req-c7640989-a951-4ee1-bbdf-3068876b83af service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-unplugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state active and task_state shelving.
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance destroyed successfully.
Apr 11 18:24:18 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Beginning cold snapshot process
Apr 11 18:24:18 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk /opt/stack/data/nova/instances/snapshots/tmphdrfjub8/3f5195b30e0d4749a48174774610ead9 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk /opt/stack/data/nova/instances/snapshots/tmphdrfjub8/3f5195b30e0d4749a48174774610ead9" returned: 0 in 0.375s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:18 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Snapshot extracted, beginning image upload
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:19 user nova-compute[82009]: WARNING nova.compute.manager [req-bc3a34ef-7e4b-4604-b6a8-5ca30fe8e108 req-78347601-a33f-4a87-a602-ba6506369ec5 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 18:24:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Snapshot image upload complete
Apr 11 18:24:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:21 user nova-compute[82009]: INFO nova.compute.manager [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Shelve offloading
Apr 11 18:24:21 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance destroyed successfully.
Apr 11 18:24:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:24:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance destroyed successfully.
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'resources' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891122104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891122104',id=29,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4UT1jM+S2X9MyxQqF+Oy/72JleNBxRkmuHwrvJGSFpmjQkv23wckhLJZtjOdqaJJ0Z7NI49IR6xFA4+Vc5wRw9Eh60mBoafHGjPt+olG1clsJEASk4rQXvE+RJNyQ5AQ==',key_name='tempest-keypair-1067458808',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-ejbm95nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member',shelved_at='2023-04-11T18:24:20.956372',shelved_host='user',shelved_image_id='3998ea14-8f4e-4300-8d4a-9d26f9b09782'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=17ecc1bd-12b1-4834-989b-607cf2eb41e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG os_vif [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap480464a5-6c, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.compute.manager [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.compute.manager [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing instance network info cache due to event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:24:22 user nova-compute[82009]: INFO os_vif [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c')
Apr 11 18:24:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Deleting instance files /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6_del
Apr 11 18:24:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Deletion of /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6_del complete
Apr 11 18:24:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:22 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Deleted allocations for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'numa_topology' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-eeb240b7-10a1-4558-a222-03a62c26949b tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.530s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updated VIF entry in instance network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap480464a5-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-986d6fae-8eb4-4b20-af4a-d16466ca20db req-c44771e5-d08e-4203-8275-97387316658e service nova] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:24 user nova-compute[82009]: INFO nova.compute.manager [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Terminating instance
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-6d89a2b7-507c-409f-824a-3cc03aa8ac35 req-253ed898-bceb-427e-aeb1-3d14b1fb41c0 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-unplugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:24:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Instance destroyed successfully.
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.objects.instance [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'resources' on Instance uuid e7908f28-28c2-4b9a-b804-042f0d186691 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-977045182',display_name='tempest-AttachVolumeTestJSON-server-977045182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-977045182',id=17,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFNupVqRl/zPMFQ5H6QEDam8sLmmpmOQFi/rIGxVaKRZsYZFiXkc9pJckkVcXYKQ0VRwPN06itGVrlwY+Y1+7DzquLnjOlB886G4q5LY56sRxG6Nh1sOaRPkBLnWhEYsg==',key_name='tempest-keypair-353094075',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-0xc8py72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=e7908f28-28c2-4b9a-b804-042f0d186691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "73d8e6ed-570b-444e-a062-22d66314138a", "address": "fa:16:3e:8b:69:25", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d8e6ed-57", "ovs_interfaceid": "73d8e6ed-570b-444e-a062-22d66314138a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG os_vif [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73d8e6ed-57, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:24 user nova-compute[82009]: INFO os_vif [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:69:25,bridge_name='br-int',has_traffic_filtering=True,id=73d8e6ed-570b-444e-a062-22d66314138a,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d8e6ed-57')
Apr 11 18:24:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Deleting instance files /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691_del
Apr 11 18:24:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Deletion of /opt/stack/data/nova/instances/e7908f28-28c2-4b9a-b804-042f0d186691_del complete
Apr 11 18:24:24 user nova-compute[82009]: INFO nova.compute.manager [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 11 18:24:24 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:24:24 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:25 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Took 0.70 seconds to deallocate network for instance.
Apr 11 18:24:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-deleted-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:25 user nova-compute[82009]: INFO nova.compute.manager [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Neutron deleted interface 73d8e6ed-570b-444e-a062-22d66314138a; detaching it from the instance and deleting it from the info cache
Apr 11 18:24:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-18386618-8469-4aa1-bac7-30c0d442e40c req-9f67558e-5e09-4856-992d-bb6e46e4e592 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Detach interface failed, port_id=73d8e6ed-570b-444e-a062-22d66314138a, reason: Instance e7908f28-28c2-4b9a-b804-042f0d186691 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:24:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:25 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Deleted allocations for instance e7908f28-28c2-4b9a-b804-042f0d186691
Apr 11 18:24:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-72b5b541-8606-4087-94da-925a94801f04 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "e7908f28-28c2-4b9a-b804-042f0d186691" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Acquiring lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] Lock "e7908f28-28c2-4b9a-b804-042f0d186691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] No waiting events found dispatching network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:26 user nova-compute[82009]: WARNING nova.compute.manager [req-aba1bc23-7bc1-461b-bab1-0612037854d0 req-cff29188-5f0f-4668-b70a-798b1908f055 service nova] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Received unexpected event network-vif-plugged-73d8e6ed-570b-444e-a062-22d66314138a for instance with vm_state deleted and task_state None.
Apr 11 18:24:27 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237452.0308309, bc37cbdb-1665-41de-bac9-b7fcf976c048 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:24:27 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] VM Stopped (Lifecycle Event)
Apr 11 18:24:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-8247f712-f1b6-4465-8024-d65325705a4a None None] [instance: bc37cbdb-1665-41de-bac9-b7fcf976c048] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:33 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237458.096181, 17ecc1bd-12b1-4834-989b-607cf2eb41e6 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:24:33 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] VM Stopped (Lifecycle Event)
Apr 11 18:24:33 user nova-compute[82009]: DEBUG nova.compute.manager [None req-fa416cbc-49dc-43d0-80eb-83239407183b None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:24:37 user nova-compute[82009]: INFO nova.compute.claims [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Claim successful on node user
Apr 11 18:24:37 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:24:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.policy [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:24:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Creating image(s)
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "/opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "/opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk 1073741824" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Cannot resize image /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.objects.instance [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'migration_context' on Instance uuid b2175ccc-960d-4eca-8e41-3783cf28410b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Ensure instance console log exists: /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:38 user nova-compute[82009]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Successfully created port: e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Successfully updated port: e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-changed-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Refreshing instance network info cache due to event network-changed-e146b0b2-5c30-4253-845d-2533c2961fcc. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Acquiring lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237464.6809697, e7908f28-28c2-4b9a-b804-042f0d186691 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:24:39 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] VM Stopped (Lifecycle Event)
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.compute.manager [None req-70a95591-62ae-4559-836d-9e263a77374e None None] [instance: e7908f28-28c2-4b9a-b804-042f0d186691] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.network.neutron [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updating instance_info_cache with network_info: [{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Instance network_info: |[{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Acquired lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.network.neutron [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Refreshing network info cache for port e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:24:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Start _get_guest_xml network_info=[{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:24:40 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:24:40 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2109686306',display_name='tempest-ServerActionsTestJSON-server-2109686306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2109686306',id=32,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-pexzg0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=b2175ccc-960d-4eca-8e41-3783cf28410b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.objects.instance [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_devices' on Instance uuid b2175ccc-960d-4eca-8e41-3783cf28410b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:24:40 user nova-compute[82009]:   <uuid>b2175ccc-960d-4eca-8e41-3783cf28410b</uuid>
Apr 11 18:24:40 user nova-compute[82009]:   <name>instance-00000020</name>
Apr 11 18:24:40 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:24:40 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:24:40 user nova-compute[82009]:   <metadata>
Apr 11 18:24:40 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:24:40 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:24:40 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-2109686306</nova:name>
Apr 11 18:24:40 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:24:40</nova:creationTime>
Apr 11 18:24:40 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:24:40 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:24:40 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:24:40 user nova-compute[82009]:       <nova:owner>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:24:40 user nova-compute[82009]:       </nova:owner>
Apr 11 18:24:40 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:24:40 user nova-compute[82009]:       <nova:ports>
Apr 11 18:24:40 user nova-compute[82009]:         <nova:port uuid="e146b0b2-5c30-4253-845d-2533c2961fcc">
Apr 11 18:24:40 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 18:24:40 user nova-compute[82009]:         </nova:port>
Apr 11 18:24:40 user nova-compute[82009]:       </nova:ports>
Apr 11 18:24:40 user nova-compute[82009]:     </nova:instance>
Apr 11 18:24:40 user nova-compute[82009]:   </metadata>
Apr 11 18:24:40 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:24:40 user nova-compute[82009]:     <system>
Apr 11 18:24:40 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:24:40 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:24:40 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:24:40 user nova-compute[82009]:       <entry name="serial">b2175ccc-960d-4eca-8e41-3783cf28410b</entry>
Apr 11 18:24:40 user nova-compute[82009]:       <entry name="uuid">b2175ccc-960d-4eca-8e41-3783cf28410b</entry>
Apr 11 18:24:40 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:24:40 user nova-compute[82009]:     </system>
Apr 11 18:24:40 user nova-compute[82009]:   </sysinfo>
Apr 11 18:24:40 user nova-compute[82009]:   <os>
Apr 11 18:24:40 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:24:40 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:24:40 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:24:40 user nova-compute[82009]:   </os>
Apr 11 18:24:40 user nova-compute[82009]:   <features>
Apr 11 18:24:40 user nova-compute[82009]:     <acpi/>
Apr 11 18:24:40 user nova-compute[82009]:     <apic/>
Apr 11 18:24:40 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:24:40 user nova-compute[82009]:   </features>
Apr 11 18:24:40 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:24:40 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:24:40 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:24:40 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:24:40 user nova-compute[82009]:   </clock>
Apr 11 18:24:40 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:24:40 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:24:40 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:24:40 user nova-compute[82009]:   </cpu>
Apr 11 18:24:40 user nova-compute[82009]:   <devices>
Apr 11 18:24:40 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:24:40 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:24:40 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk"/>
Apr 11 18:24:40 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:24:40 user nova-compute[82009]:     </disk>
Apr 11 18:24:40 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:24:40 user nova-compute[82009]:       <mac address="fa:16:3e:b5:6a:54"/>
Apr 11 18:24:40 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:24:40 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:24:40 user nova-compute[82009]:       <target dev="tape146b0b2-5c"/>
Apr 11 18:24:40 user nova-compute[82009]:     </interface>
Apr 11 18:24:40 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:24:40 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/console.log" append="off"/>
Apr 11 18:24:40 user nova-compute[82009]:     </serial>
Apr 11 18:24:40 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:24:40 user nova-compute[82009]:     <video>
Apr 11 18:24:40 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:24:40 user nova-compute[82009]:     </video>
Apr 11 18:24:40 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:24:40 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:24:40 user nova-compute[82009]:     </rng>
Apr 11 18:24:40 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:24:40 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:24:40 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:24:40 user nova-compute[82009]:     </memballoon>
Apr 11 18:24:40 user nova-compute[82009]:   </devices>
Apr 11 18:24:40 user nova-compute[82009]: </domain>
Apr 11 18:24:40 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2109686306',display_name='tempest-ServerActionsTestJSON-server-2109686306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2109686306',id=32,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-pexzg0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=b2175ccc-960d-4eca-8e41-3783cf28410b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG os_vif [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape146b0b2-5c, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape146b0b2-5c, col_values=(('external_ids', {'iface-id': 'e146b0b2-5c30-4253-845d-2533c2961fcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:6a:54', 'vm-uuid': 'b2175ccc-960d-4eca-8e41-3783cf28410b'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:40 user nova-compute[82009]: INFO os_vif [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c')
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:b5:6a:54, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.network.neutron [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updated VIF entry in instance network info cache for port e146b0b2-5c30-4253-845d-2533c2961fcc. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG nova.network.neutron [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updating instance_info_cache with network_info: [{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:24:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a60e293d-002e-47e7-a591-20b2f95cf42d req-21597f12-5c7d-40a5-bbc4-7fae75e8e4a4 service nova] Releasing lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] No waiting events found dispatching network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:41 user nova-compute[82009]: WARNING nova.compute.manager [req-3c23c75a-6fb5-4f99-9425-2c6e3b226643 req-e6055cb2-7d03-4af5-a83d-899948446165 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received unexpected event network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc for instance with vm_state building and task_state spawning.
Apr 11 18:24:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237483.6952794, b2175ccc-960d-4eca-8e41-3783cf28410b => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] VM Resumed (Lifecycle Event)
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Instance spawned successfully.
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237483.696724, b2175ccc-960d-4eca-8e41-3783cf28410b => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] VM Started (Lifecycle Event)
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] No waiting events found dispatching network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:24:43 user nova-compute[82009]: WARNING nova.compute.manager [req-6df50d77-d697-4799-a429-e122490b2ed1 req-d9443432-12f2-46cd-921c-8765c5a0b983 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received unexpected event network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc for instance with vm_state building and task_state spawning.
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 11 18:24:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:24:43 user nova-compute[82009]: INFO nova.compute.manager [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Took 6.26 seconds to build instance.
Apr 11 18:24:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-46b90700-aefe-4943-9bfe-a45e0c59a7a5 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.360s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:24:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:24:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:24:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:24:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:24:59 user nova-compute[82009]: INFO nova.compute.claims [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Claim successful on node user
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:24:59 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:24:59 user nova-compute[82009]: INFO nova.virt.block_device [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Booting with volume snapshot de2bec89-492e-43fb-9030-13bed6ed9431 at /dev/vda
Apr 11 18:24:59 user nova-compute[82009]: DEBUG nova.policy [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:24:59 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Successfully created port: 6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:25:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Successfully updated port: 6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "refresh_cache-ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquired lock "refresh_cache-ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-changed-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Refreshing instance network info cache due to event network-changed-6fa719a1-80b1-4fde-8d1c-09d119fccdb9. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Acquiring lock "refresh_cache-ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [{"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-216db027-e3a6-4027-9aa7-07031623c674" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Updating instance_info_cache with network_info: [{"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Releasing lock "refresh_cache-ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Instance network_info: |[{"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Acquired lock "refresh_cache-ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Refreshing network info cache for port 6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Updated VIF entry in instance network info cache for port 6fa719a1-80b1-4fde-8d1c-09d119fccdb9. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Updating instance_info_cache with network_info: [{"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-21d10de2-6b57-43a8-84fa-dc5f7a65cc15 req-6f4bdbcc-da3d-40dd-bc20-f35a943d039a service nova] Releasing lock "refresh_cache-ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:25:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:02 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:02 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:03 user nova-compute[82009]: INFO nova.compute.manager [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Terminating instance
Apr 11 18:25:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-9965585a-1469-448a-8ad4-5354be99d9d4 req-4615c502-2687-4bd8-aa4e-968f929d7400 service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-unplugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Instance destroyed successfully.
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'resources' on Instance uuid c5a2e113-75f7-47ac-bdf9-458793a62061 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2027322626',display_name='tempest-ServerRescueNegativeTestJSON-server-2027322626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2027322626',id=24,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFIK5aPskfsOVBBGyw4yEbsLtMQvwJFTLOan+Twhh4tjr/C3BYu6u/4BceyXCRAua8zDa2ccvRw2H6FAdWFmjwazVukCovMZ6BukRUwqQ+pfLxuRzbwDkNupsMXFG9o8Q==',key_name='tempest-keypair-1641901033',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-u5jbgqkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=c5a2e113-75f7-47ac-bdf9-458793a62061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "address": "fa:16:3e:b5:43:66", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de8f180-0b", "ovs_interfaceid": "2de8f180-0b9b-405b-abcd-f44d2c15a437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG os_vif [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2de8f180-0b, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:25:04 user nova-compute[82009]: INFO os_vif [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:43:66,bridge_name='br-int',has_traffic_filtering=True,id=2de8f180-0b9b-405b-abcd-f44d2c15a437,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de8f180-0b')
Apr 11 18:25:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Deleting instance files /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061_del
Apr 11 18:25:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Deletion of /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061_del complete
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json" returned: 1 in 0.164s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk --force-share --output=json' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:25:04 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000018, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c5a2e113-75f7-47ac-bdf9-458793a62061/disk
Apr 11 18:25:04 user nova-compute[82009]: INFO nova.compute.manager [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 18:25:04 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:25:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:25:05 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:05 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=26.35516357421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 216db027-e3a6-4027-9aa7-07031623c674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance c5a2e113-75f7-47ac-bdf9-458793a62061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG os_brick.utils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb601b-c9c1-4d47-bd18-4ba9d421b802]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e00cf1-18db-4907-a687-dc3c109d28f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865775a-3971-437a-836b-7a989ec3d486]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672b8ad-32e3-4f0a-9b19-24dfd5357b72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:25:05 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b236792-49f6-4c67-9851-81f933ef60a4]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG os_brick.utils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Updating existing volume attachment record: 2f48b9e6-1220-41b8-a9b5-247ddc450875 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:25:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Acquiring lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] No waiting events found dispatching network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:06 user nova-compute[82009]: WARNING nova.compute.manager [req-e638767e-adbd-404d-bab4-ed7cf06e1b72 req-9c5df636-79b0-4987-8791-de4585b7cb7e service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received unexpected event network-vif-plugged-2de8f180-0b9b-405b-abcd-f44d2c15a437 for instance with vm_state active and task_state deleting.
Apr 11 18:25:06 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:06 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Took 1.67 seconds to deallocate network for instance.
Apr 11 18:25:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-a8538e6a-9d56-41e5-8194-ef106d8321cd req-261a2c0b-bdae-47fc-8e6c-3ad457ccd4ba service nova] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Received event network-vif-deleted-2de8f180-0b9b-405b-abcd-f44d2c15a437 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:06 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Deleted allocations for instance c5a2e113-75f7-47ac-bdf9-458793a62061
Apr 11 18:25:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b43c51fb-9fdb-41d2-961e-659bce5b73ef tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "c5a2e113-75f7-47ac-bdf9-458793a62061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:25:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:25:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Creating image(s)
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Ensure instance console log exists: /opt/stack/data/nova/instances/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Start _get_guest_xml network_info=[{"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T18:24:57Z,direct_url=<?>,disk_format='qcow2',id=dc2a2ec9-eac7-4c6e-a001-0159eb253657,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1701323259',owner='e4f6857b777f4207b93d8c28aa39054b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T18:24:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f48b9e6-1220-41b8-a9b5-247ddc450875', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlQaVOeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae5c052e-8a58-4adb-98b9-39f8a4c2a97c', 'attached_at': '', 'detached_at': '', 'volume_id': '78afcf33-7276-41f4-a849-cdf6ce2d6014', 'serial': '78afcf33-7276-41f4-a849-cdf6ce2d6014'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:25:10 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:10 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T18:24:57Z,direct_url=<?>,disk_format='qcow2',id=dc2a2ec9-eac7-4c6e-a001-0159eb253657,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1701323259',owner='e4f6857b777f4207b93d8c28aa39054b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T18:24:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlQaVOeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:25:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:25:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:25:10 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e02bd7-0504-4066-b181-f276363b8ba6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:25:10 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d5353b-3778-4e81-9e60-75176209b6f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014] added
Apr 11 18:25:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b8055-c449-43bf-82be-c451d6ee7649]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.067s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b59e8-960b-445c-af4e-2f57b21dbe51]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlQaVOeL {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlQaVOeL" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f628bcb-5237-4008-8fcb-52b729412e04]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wlQaVOeL'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0522210-f9eb-481c-a8c7-4746d2284e9d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1075bb0-5c2b-4ae7-a6c7-8894e669fddb]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[312b1fd8-534e-46aa-8da2-ed734ba8c0b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260]
Apr 11 18:25:10 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260] successful.
Apr 11 18:25:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097d374-b97f-4b28-8bb3-2ebcfa933ce8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e8d0a5-d089-4b3a-9424-e5da3dce512c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:25:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc22471e-43e1-4537-b7ce-d12689536552]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlQaVOeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23266646662323262', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266646662323262', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-473236277',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-473236277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-473236277',id=33,image_ref='dc2a2ec9-eac7-4c6e-a001-0159eb253657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-at4ruoc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1768143130',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:25:00Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=ae5c052e-8a58-4adb-98b9-39f8a4c2a97c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'pci_devices' on Instance uuid ae5c052e-8a58-4adb-98b9-39f8a4c2a97c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:25:11 user nova-compute[82009]:   <uuid>ae5c052e-8a58-4adb-98b9-39f8a4c2a97c</uuid>
Apr 11 18:25:11 user nova-compute[82009]:   <name>instance-00000021</name>
Apr 11 18:25:11 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:25:11 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:25:11 user nova-compute[82009]:   <metadata>
Apr 11 18:25:11 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:25:11 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:25:11 user nova-compute[82009]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-473236277</nova:name>
Apr 11 18:25:11 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:25:10</nova:creationTime>
Apr 11 18:25:11 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:25:11 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:25:11 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:25:11 user nova-compute[82009]:       <nova:owner>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:user uuid="4c8825bcd5894c999412499de320dc00">tempest-TestVolumeBootPattern-1768143130-project-member</nova:user>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:project uuid="e4f6857b777f4207b93d8c28aa39054b">tempest-TestVolumeBootPattern-1768143130</nova:project>
Apr 11 18:25:11 user nova-compute[82009]:       </nova:owner>
Apr 11 18:25:11 user nova-compute[82009]:       <nova:root type="image" uuid="dc2a2ec9-eac7-4c6e-a001-0159eb253657"/>
Apr 11 18:25:11 user nova-compute[82009]:       <nova:ports>
Apr 11 18:25:11 user nova-compute[82009]:         <nova:port uuid="6fa719a1-80b1-4fde-8d1c-09d119fccdb9">
Apr 11 18:25:11 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:25:11 user nova-compute[82009]:         </nova:port>
Apr 11 18:25:11 user nova-compute[82009]:       </nova:ports>
Apr 11 18:25:11 user nova-compute[82009]:     </nova:instance>
Apr 11 18:25:11 user nova-compute[82009]:   </metadata>
Apr 11 18:25:11 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:25:11 user nova-compute[82009]:     <system>
Apr 11 18:25:11 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:25:11 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:25:11 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:25:11 user nova-compute[82009]:       <entry name="serial">ae5c052e-8a58-4adb-98b9-39f8a4c2a97c</entry>
Apr 11 18:25:11 user nova-compute[82009]:       <entry name="uuid">ae5c052e-8a58-4adb-98b9-39f8a4c2a97c</entry>
Apr 11 18:25:11 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:25:11 user nova-compute[82009]:     </system>
Apr 11 18:25:11 user nova-compute[82009]:   </sysinfo>
Apr 11 18:25:11 user nova-compute[82009]:   <os>
Apr 11 18:25:11 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:25:11 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:25:11 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:25:11 user nova-compute[82009]:   </os>
Apr 11 18:25:11 user nova-compute[82009]:   <features>
Apr 11 18:25:11 user nova-compute[82009]:     <acpi/>
Apr 11 18:25:11 user nova-compute[82009]:     <apic/>
Apr 11 18:25:11 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:25:11 user nova-compute[82009]:   </features>
Apr 11 18:25:11 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:25:11 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:25:11 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:25:11 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:25:11 user nova-compute[82009]:   </clock>
Apr 11 18:25:11 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:25:11 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:25:11 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:25:11 user nova-compute[82009]:   </cpu>
Apr 11 18:25:11 user nova-compute[82009]:   <devices>
Apr 11 18:25:11 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:25:11 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:25:11 user nova-compute[82009]:       <source dev="/dev/sdd"/>
Apr 11 18:25:11 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:25:11 user nova-compute[82009]:       <serial>78afcf33-7276-41f4-a849-cdf6ce2d6014</serial>
Apr 11 18:25:11 user nova-compute[82009]:     </disk>
Apr 11 18:25:11 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:25:11 user nova-compute[82009]:       <mac address="fa:16:3e:59:98:22"/>
Apr 11 18:25:11 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:25:11 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:25:11 user nova-compute[82009]:       <target dev="tap6fa719a1-80"/>
Apr 11 18:25:11 user nova-compute[82009]:     </interface>
Apr 11 18:25:11 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:25:11 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c/console.log" append="off"/>
Apr 11 18:25:11 user nova-compute[82009]:     </serial>
Apr 11 18:25:11 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:25:11 user nova-compute[82009]:     <video>
Apr 11 18:25:11 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:25:11 user nova-compute[82009]:     </video>
Apr 11 18:25:11 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:25:11 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:25:11 user nova-compute[82009]:     </rng>
Apr 11 18:25:11 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:25:11 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:25:11 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:25:11 user nova-compute[82009]:     </memballoon>
Apr 11 18:25:11 user nova-compute[82009]:   </devices>
Apr 11 18:25:11 user nova-compute[82009]: </domain>
Apr 11 18:25:11 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-473236277',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-473236277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-473236277',id=33,image_ref='dc2a2ec9-eac7-4c6e-a001-0159eb253657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-at4ruoc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1768143130',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:25:00Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=ae5c052e-8a58-4adb-98b9-39f8a4c2a97c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG os_vif [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fa719a1-80, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fa719a1-80, col_values=(('external_ids', {'iface-id': '6fa719a1-80b1-4fde-8d1c-09d119fccdb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:98:22', 'vm-uuid': 'ae5c052e-8a58-4adb-98b9-39f8a4c2a97c'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:11 user nova-compute[82009]: INFO os_vif [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80')
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:25:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No VIF found with MAC fa:16:3e:59:98:22, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:25:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] No waiting events found dispatching network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:13 user nova-compute[82009]: WARNING nova.compute.manager [req-c55b347a-7be9-40c6-b85a-7f2c87a320c3 req-7f769d7d-26b5-467d-8b9e-101e269e6218 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received unexpected event network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance with vm_state building and task_state spawning.
Apr 11 18:25:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237515.018412, ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] VM Resumed (Lifecycle Event)
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Instance spawned successfully.
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237515.019463, ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] VM Started (Lifecycle Event)
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:15 user nova-compute[82009]: INFO nova.compute.manager [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Took 15.96 seconds to build instance.
Apr 11 18:25:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-dd55dc23-982c-421b-9ae1-3154b77b3b55 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.054s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] No waiting events found dispatching network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:15 user nova-compute[82009]: WARNING nova.compute.manager [req-b609206c-758c-4503-bffe-8f17d5453aad req-b4f88269-18e4-4357-bdec-c4ed41f60281 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received unexpected event network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance with vm_state active and task_state None.
Apr 11 18:25:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:25:19 user nova-compute[82009]: INFO nova.compute.claims [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Claim successful on node user
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237504.579988, c5a2e113-75f7-47ac-bdf9-458793a62061 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:19 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] VM Stopped (Lifecycle Event)
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-a015552d-ed1d-474d-a12b-f7bde34cbbbe None None] [instance: c5a2e113-75f7-47ac-bdf9-458793a62061] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:25:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.policy [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b852c50aeb514b7fbe5a9b72e8bbdc14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77a56502d9848a3842c938d5adc8c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:25:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Creating image(s)
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "/opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "/opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "/opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk 1073741824" returned: 0 in 0.050s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Cannot resize image /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG nova.objects.instance [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'migration_context' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Ensure instance console log exists: /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:20 user nova-compute[82009]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Successfully created port: fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Successfully updated port: fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquired lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-changed-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Refreshing instance network info cache due to event network-changed-fab46756-563a-4dbb-bbb5-b2b4722e7a57. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Acquiring lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updating instance_info_cache with network_info: [{"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Releasing lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Instance network_info: |[{"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Acquired lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Refreshing network info cache for port fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Start _get_guest_xml network_info=[{"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:25:21 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:21 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1211420081',display_name='tempest-AttachVolumeTestJSON-server-1211420081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1211420081',id=34,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqSkOsVWWiQJY+4Uhu/FVlYzwpA9r4NiOcAw/vTuyzs+NADfEQsbFTqqlwK/uPXN4CA0MSgtJUJtml4jJTgDvkQuRFevMxDr03QFffyWHyb3yDt1o4/Scj9arSvVLcxfA==',key_name='tempest-keypair-1800185275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-ofvsa9aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=bba677b9-2c44-4f9c-a7d9-7e9098c98fb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.objects.instance [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'pci_devices' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:25:21 user nova-compute[82009]:   <uuid>bba677b9-2c44-4f9c-a7d9-7e9098c98fb8</uuid>
Apr 11 18:25:21 user nova-compute[82009]:   <name>instance-00000022</name>
Apr 11 18:25:21 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:25:21 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:25:21 user nova-compute[82009]:   <metadata>
Apr 11 18:25:21 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:25:21 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:25:21 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeTestJSON-server-1211420081</nova:name>
Apr 11 18:25:21 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:25:21</nova:creationTime>
Apr 11 18:25:21 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:25:21 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:25:21 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:25:21 user nova-compute[82009]:       <nova:owner>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:user uuid="b852c50aeb514b7fbe5a9b72e8bbdc14">tempest-AttachVolumeTestJSON-369540173-project-member</nova:user>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:project uuid="d77a56502d9848a3842c938d5adc8c51">tempest-AttachVolumeTestJSON-369540173</nova:project>
Apr 11 18:25:21 user nova-compute[82009]:       </nova:owner>
Apr 11 18:25:21 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:25:21 user nova-compute[82009]:       <nova:ports>
Apr 11 18:25:21 user nova-compute[82009]:         <nova:port uuid="fab46756-563a-4dbb-bbb5-b2b4722e7a57">
Apr 11 18:25:21 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 18:25:21 user nova-compute[82009]:         </nova:port>
Apr 11 18:25:21 user nova-compute[82009]:       </nova:ports>
Apr 11 18:25:21 user nova-compute[82009]:     </nova:instance>
Apr 11 18:25:21 user nova-compute[82009]:   </metadata>
Apr 11 18:25:21 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:25:21 user nova-compute[82009]:     <system>
Apr 11 18:25:21 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:25:21 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:25:21 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:25:21 user nova-compute[82009]:       <entry name="serial">bba677b9-2c44-4f9c-a7d9-7e9098c98fb8</entry>
Apr 11 18:25:21 user nova-compute[82009]:       <entry name="uuid">bba677b9-2c44-4f9c-a7d9-7e9098c98fb8</entry>
Apr 11 18:25:21 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:25:21 user nova-compute[82009]:     </system>
Apr 11 18:25:21 user nova-compute[82009]:   </sysinfo>
Apr 11 18:25:21 user nova-compute[82009]:   <os>
Apr 11 18:25:21 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:25:21 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:25:21 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:25:21 user nova-compute[82009]:   </os>
Apr 11 18:25:21 user nova-compute[82009]:   <features>
Apr 11 18:25:21 user nova-compute[82009]:     <acpi/>
Apr 11 18:25:21 user nova-compute[82009]:     <apic/>
Apr 11 18:25:21 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:25:21 user nova-compute[82009]:   </features>
Apr 11 18:25:21 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:25:21 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:25:21 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:25:21 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:25:21 user nova-compute[82009]:   </clock>
Apr 11 18:25:21 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:25:21 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:25:21 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:25:21 user nova-compute[82009]:   </cpu>
Apr 11 18:25:21 user nova-compute[82009]:   <devices>
Apr 11 18:25:21 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:25:21 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:25:21 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk"/>
Apr 11 18:25:21 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:25:21 user nova-compute[82009]:     </disk>
Apr 11 18:25:21 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:25:21 user nova-compute[82009]:       <mac address="fa:16:3e:08:37:7e"/>
Apr 11 18:25:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:25:21 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:25:21 user nova-compute[82009]:       <target dev="tapfab46756-56"/>
Apr 11 18:25:21 user nova-compute[82009]:     </interface>
Apr 11 18:25:21 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:25:21 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/console.log" append="off"/>
Apr 11 18:25:21 user nova-compute[82009]:     </serial>
Apr 11 18:25:21 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:25:21 user nova-compute[82009]:     <video>
Apr 11 18:25:21 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:25:21 user nova-compute[82009]:     </video>
Apr 11 18:25:21 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:25:21 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:25:21 user nova-compute[82009]:     </rng>
Apr 11 18:25:21 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:25:21 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:25:21 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:25:21 user nova-compute[82009]:     </memballoon>
Apr 11 18:25:21 user nova-compute[82009]:   </devices>
Apr 11 18:25:21 user nova-compute[82009]: </domain>
Apr 11 18:25:21 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1211420081',display_name='tempest-AttachVolumeTestJSON-server-1211420081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1211420081',id=34,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqSkOsVWWiQJY+4Uhu/FVlYzwpA9r4NiOcAw/vTuyzs+NADfEQsbFTqqlwK/uPXN4CA0MSgtJUJtml4jJTgDvkQuRFevMxDr03QFffyWHyb3yDt1o4/Scj9arSvVLcxfA==',key_name='tempest-keypair-1800185275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-ofvsa9aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=bba677b9-2c44-4f9c-a7d9-7e9098c98fb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG os_vif [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfab46756-56, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfab46756-56, col_values=(('external_ids', {'iface-id': 'fab46756-563a-4dbb-bbb5-b2b4722e7a57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:37:7e', 'vm-uuid': 'bba677b9-2c44-4f9c-a7d9-7e9098c98fb8'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:21 user nova-compute[82009]: INFO os_vif [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56')
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:25:21 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No VIF found with MAC fa:16:3e:08:37:7e, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:25:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updated VIF entry in instance network info cache for port fab46756-563a-4dbb-bbb5-b2b4722e7a57. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:25:22 user nova-compute[82009]: DEBUG nova.network.neutron [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updating instance_info_cache with network_info: [{"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e88c21eb-c651-458f-95df-e8775f272d22 req-4fc614e2-0ffd-4e8f-be93-836d56b7cff0 service nova] Releasing lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] No waiting events found dispatching network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:23 user nova-compute[82009]: WARNING nova.compute.manager [req-70d07549-49c2-4ef0-a815-d1495bf46f4e req-906d795b-43de-4802-814a-1390598030db service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received unexpected event network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance with vm_state building and task_state spawning.
Apr 11 18:25:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237525.6682453, bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] VM Resumed (Lifecycle Event)
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Instance spawned successfully.
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237525.6703002, bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] VM Started (Lifecycle Event)
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] No waiting events found dispatching network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:25 user nova-compute[82009]: WARNING nova.compute.manager [req-29f5535c-547f-4d2b-a9cf-ef33161dd1a5 req-30d5ba86-cf5d-468c-902a-c6c0e75dabc9 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received unexpected event network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance with vm_state building and task_state spawning.
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Took 5.94 seconds to spawn the instance on the hypervisor.
Apr 11 18:25:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:25 user nova-compute[82009]: INFO nova.compute.manager [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Took 6.67 seconds to build instance.
Apr 11 18:25:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-843dc882-4f1b-4a17-a724-61c9b9ba7ec8 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:34 user nova-compute[82009]: INFO nova.compute.manager [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Rescuing
Apr 11 18:25:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:25:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:25:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:25:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG nova.compute.manager [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:35 user nova-compute[82009]: WARNING nova.compute.manager [req-0688a71a-c234-406c-a6ea-2d7feff9c147 req-14004236-d8ca-46ca-9649-3224fdc1901e service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state active and task_state rescuing.
Apr 11 18:25:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:35 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance destroyed successfully.
Apr 11 18:25:35 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Attempting a stable device rescue
Apr 11 18:25:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82009) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:25:36 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Creating image(s)
Apr 11 18:25:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "/opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'trusted_certs' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "275c16ac96a821c2b0aaffb035983f891acd2618" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "275c16ac96a821c2b0aaffb035983f891acd2618" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.part --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.images [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 0054f394-9912-47f5-b40e-89b05f0e018a was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.part /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.compute.manager [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:37 user nova-compute[82009]: WARNING nova.compute.manager [req-91096363-c63b-47f4-945c-8e7f2890776e req-e0a271d5-dbe2-4a5e-9125-64e230975dcd service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state active and task_state rescuing.
Apr 11 18:25:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.part /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.converted" returned: 0 in 0.428s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "275c16ac96a821c2b0aaffb035983f891acd2618" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.556s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "275c16ac96a821c2b0aaffb035983f891acd2618" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "275c16ac96a821c2b0aaffb035983f891acd2618" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618 --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618,backing_fmt=raw /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618,backing_fmt=raw /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "275c16ac96a821c2b0aaffb035983f891acd2618" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'migration_context' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Start _get_guest_xml network_info=[{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "vif_mac": "fa:16:3e:78:f3:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0054f394-9912-47f5-b40e-89b05f0e018a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cd66160-6b00-4eb3-b8ef-a3ccf0613cd8', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'bef10824-ced0-49d5-934a-c509ab119cbf', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca57292f-f0c4-4b01-87ee-f7266c363937', 'serial': 'ca57292f-f0c4-4b01-87ee-f7266c363937'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'resources' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'numa_topology' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:37 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:37 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'vcpu_model' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:25:37 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:25:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:25:37 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:25:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:25:37 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3945090-40d3-4cd1-878b-b54cd030dab7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nEQxHqeL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 18:25:37 user nova-compute[82009]: node.name = iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:25:37 user nova-compute[82009]: node.tpgt = -1
Apr 11 18:25:37 user nova-compute[82009]: node.startup = automatic
Apr 11 18:25:37 user nova-compute[82009]: node.leading_login = No
Apr 11 18:25:37 user nova-compute[82009]: iface.iscsi_ifacename = default
Apr 11 18:25:37 user nova-compute[82009]: iface.net_ifacename = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.ipaddress = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.prefix_len = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.hwaddress = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.transport_name = tcp
Apr 11 18:25:37 user nova-compute[82009]: iface.initiatorname = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.vlan_id = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.vlan_priority = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.vlan_state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.iface_num = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.mtu = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.port = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.bootproto = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.subnet_mask = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.gateway = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_alt_client_id = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_dns = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_learn_iqn = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_vendor_id_state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_vendor_id = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.dhcp_slp_da = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.fragmentation = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.gratuitous_arp = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.incoming_forwarding = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.tos_state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.tos = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.ttl = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.delayed_ack = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.tcp_nagle = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.tcp_wsf_state = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.tcp_wsf = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.tcp_timer_scale = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.tcp_timestamp = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.redirect = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.def_task_mgmt_timeout = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.header_digest = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.data_digest = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.immediate_data = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.initial_r2t = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.data_seq_inorder = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.data_pdu_inorder = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.erl = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.max_receive_data_len = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.first_burst_len = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.max_outstanding_r2t = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.max_burst_len = 0
Apr 11 18:25:37 user nova-compute[82009]: iface.chap_auth = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.bidi_chap = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.strict_login_compliance = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.discovery_auth = <empty>
Apr 11 18:25:37 user nova-compute[82009]: iface.discovery_logout = <empty>
Apr 11 18:25:37 user nova-compute[82009]: node.discovery_address = <empty>
Apr 11 18:25:37 user nova-compute[82009]: node.discovery_port = 0
Apr 11 18:25:37 user nova-compute[82009]: node.discovery_type = static
Apr 11 18:25:37 user nova-compute[82009]: node.session.initial_cmdsn = 0
Apr 11 18:25:37 user nova-compute[82009]: node.session.initial_login_retry_max = 8
Apr 11 18:25:37 user nova-compute[82009]: node.session.xmit_thread_priority = -20
Apr 11 18:25:37 user nova-compute[82009]: node.session.cmds_max = 128
Apr 11 18:25:37 user nova-compute[82009]: node.session.queue_depth = 32
Apr 11 18:25:37 user nova-compute[82009]: node.session.nr_sessions = 1
Apr 11 18:25:37 user nova-compute[82009]: node.session.auth.authmethod = CHAP
Apr 11 18:25:37 user nova-compute[82009]: node.session.auth.username = nEQxHqeL
Apr 11 18:25:37 user nova-compute[82009]: node.session.auth.password = ***
Apr 11 18:25:37 user nova-compute[82009]: node.session.auth.username_in = <empty>
Apr 11 18:25:37 user nova-compute[82009]: node.session.auth.password_in = <empty>
Apr 11 18:25:37 user nova-compute[82009]: node.session.auth.chap_algs = MD5
Apr 11 18:25:37 user nova-compute[82009]: node.session.timeo.replacement_timeout = 120
Apr 11 18:25:37 user nova-compute[82009]: node.session.err_timeo.abort_timeout = 15
Apr 11 18:25:37 user nova-compute[82009]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 18:25:37 user nova-compute[82009]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 18:25:37 user nova-compute[82009]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.FastAbort = Yes
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.InitialR2T = No
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.ImmediateData = Yes
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.MaxConnections = 1
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 18:25:37 user nova-compute[82009]: node.session.iscsi.ERL = 0
Apr 11 18:25:37 user nova-compute[82009]: node.session.scan = manual
Apr 11 18:25:37 user nova-compute[82009]: node.session.reopen_max = 0
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].address = 172.16.0.220
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].port = 3260
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].startup = manual
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].tcp.window_size = 524288
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].tcp.type_of_service = 0
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].timeo.logout_timeout = 15
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].timeo.login_timeout = 15
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].timeo.auth_timeout = 45
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].iscsi.DataDigest = None
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].iscsi.IFMarker = No
Apr 11 18:25:37 user nova-compute[82009]: node.conn[0].iscsi.OFMarker = No
Apr 11 18:25:37 user nova-compute[82009]: # END RECORD
Apr 11 18:25:37 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4454e4c-9509-47b5-8c4a-d7f3d4b28f92]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf0f05-a62a-47a4-92c5-44fd43f83aac]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEQxHqeL {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEQxHqeL" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[194da8f4-cdeb-4779-8b22-863e4300609f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nEQxHqeL'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb39c248-18d5-46fa-8f45-4937b534c3c4]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b8b80-416e-476a-99d1-0f8c89c4663f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:25:38 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:25:38 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:25:38 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:25:38 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:25:38 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:25:38 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HCTL ('34', '0', '0', 0) found on session 37 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83cc3fe-755f-442a-8643-ed00d9afa87f]: (4, ('0 0 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Searching for a device in session 37 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23036343033653765', 'path': '/dev/sdc'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036343033653765', 'path': '/dev/sdc'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1868063970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1868063970',id=31,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-n3t3bpyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:23:59Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=bef10824-ced0-49d5-934a-c509ab119cbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "vif_mac": "fa:16:3e:78:f3:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "vif_mac": "fa:16:3e:78:f3:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'pci_devices' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:25:38 user nova-compute[82009]:   <uuid>bef10824-ced0-49d5-934a-c509ab119cbf</uuid>
Apr 11 18:25:38 user nova-compute[82009]:   <name>instance-0000001f</name>
Apr 11 18:25:38 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:25:38 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:25:38 user nova-compute[82009]:   <metadata>
Apr 11 18:25:38 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:25:38 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:25:38 user nova-compute[82009]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1868063970</nova:name>
Apr 11 18:25:38 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:25:37</nova:creationTime>
Apr 11 18:25:38 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:25:38 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:25:38 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:25:38 user nova-compute[82009]:       <nova:owner>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:user uuid="fde784625fda4447afc0b8e9bd0983a3">tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member</nova:user>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:project uuid="62a254c432f54e1b8735e40af7063506">tempest-ServerBootFromVolumeStableRescueTest-1689319261</nova:project>
Apr 11 18:25:38 user nova-compute[82009]:       </nova:owner>
Apr 11 18:25:38 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:25:38 user nova-compute[82009]:       <nova:ports>
Apr 11 18:25:38 user nova-compute[82009]:         <nova:port uuid="d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9">
Apr 11 18:25:38 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 18:25:38 user nova-compute[82009]:         </nova:port>
Apr 11 18:25:38 user nova-compute[82009]:       </nova:ports>
Apr 11 18:25:38 user nova-compute[82009]:     </nova:instance>
Apr 11 18:25:38 user nova-compute[82009]:   </metadata>
Apr 11 18:25:38 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:25:38 user nova-compute[82009]:     <system>
Apr 11 18:25:38 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:25:38 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:25:38 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:25:38 user nova-compute[82009]:       <entry name="serial">bef10824-ced0-49d5-934a-c509ab119cbf</entry>
Apr 11 18:25:38 user nova-compute[82009]:       <entry name="uuid">bef10824-ced0-49d5-934a-c509ab119cbf</entry>
Apr 11 18:25:38 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:25:38 user nova-compute[82009]:     </system>
Apr 11 18:25:38 user nova-compute[82009]:   </sysinfo>
Apr 11 18:25:38 user nova-compute[82009]:   <os>
Apr 11 18:25:38 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:25:38 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:25:38 user nova-compute[82009]:   </os>
Apr 11 18:25:38 user nova-compute[82009]:   <features>
Apr 11 18:25:38 user nova-compute[82009]:     <acpi/>
Apr 11 18:25:38 user nova-compute[82009]:     <apic/>
Apr 11 18:25:38 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:25:38 user nova-compute[82009]:   </features>
Apr 11 18:25:38 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:25:38 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:25:38 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:25:38 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:25:38 user nova-compute[82009]:   </clock>
Apr 11 18:25:38 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:25:38 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:25:38 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:25:38 user nova-compute[82009]:   </cpu>
Apr 11 18:25:38 user nova-compute[82009]:   <devices>
Apr 11 18:25:38 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:25:38 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:25:38 user nova-compute[82009]:       <source dev="/dev/sdc"/>
Apr 11 18:25:38 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:25:38 user nova-compute[82009]:       <serial>ca57292f-f0c4-4b01-87ee-f7266c363937</serial>
Apr 11 18:25:38 user nova-compute[82009]:     </disk>
Apr 11 18:25:38 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:25:38 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:25:38 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue"/>
Apr 11 18:25:38 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:25:38 user nova-compute[82009]:       <boot order="1"/>
Apr 11 18:25:38 user nova-compute[82009]:     </disk>
Apr 11 18:25:38 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:25:38 user nova-compute[82009]:       <mac address="fa:16:3e:78:f3:ac"/>
Apr 11 18:25:38 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:25:38 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:25:38 user nova-compute[82009]:       <target dev="tapd2a4d7d0-fb"/>
Apr 11 18:25:38 user nova-compute[82009]:     </interface>
Apr 11 18:25:38 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:25:38 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/console.log" append="off"/>
Apr 11 18:25:38 user nova-compute[82009]:     </serial>
Apr 11 18:25:38 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:25:38 user nova-compute[82009]:     <video>
Apr 11 18:25:38 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:25:38 user nova-compute[82009]:     </video>
Apr 11 18:25:38 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:25:38 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:25:38 user nova-compute[82009]:     </rng>
Apr 11 18:25:38 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:25:38 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:25:38 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:25:38 user nova-compute[82009]:     </memballoon>
Apr 11 18:25:38 user nova-compute[82009]:   </devices>
Apr 11 18:25:38 user nova-compute[82009]: </domain>
Apr 11 18:25:38 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:25:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance destroyed successfully.
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:25:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No VIF found with MAC fa:16:3e:78:f3:ac, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:39 user nova-compute[82009]: WARNING nova.compute.manager [req-c622e61b-1cd5-4f7f-b3e6-2d3d485153a1 req-3b0f8d51-1066-46fb-a5d7-22a6f305675a service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state active and task_state rescuing.
Apr 11 18:25:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for bef10824-ced0-49d5-934a-c509ab119cbf due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237541.7069376, bef10824-ced0-49d5-934a-c509ab119cbf => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Resumed (Lifecycle Event)
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-0728f4bc-414d-4ca5-b23e-c1b7721bb2ae tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:25:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237541.708436, bef10824-ced0-49d5-934a-c509ab119cbf => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:25:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Started (Lifecycle Event)
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:41 user nova-compute[82009]: WARNING nova.compute.manager [req-539f6e01-0e62-4bd5-a813-05edca43f5ee req-2e126946-2a9c-4836-bb24-33e833ff707c service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state active and task_state rescuing.
Apr 11 18:25:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:50 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:25:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "216db027-e3a6-4027-9aa7-07031623c674" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:57 user nova-compute[82009]: INFO nova.compute.manager [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Terminating instance
Apr 11 18:25:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-unplugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-unplugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-06e1b306-f956-43b0-a1a4-81245380accf req-4e2b81d2-53fa-451f-aea0-304fc9f22753 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-unplugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:25:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Instance destroyed successfully.
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.objects.instance [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'resources' on Instance uuid 216db027-e3a6-4027-9aa7-07031623c674 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1852666843',display_name='tempest-ServerRescueNegativeTestJSON-server-1852666843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1852666843',id=3,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:12:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xxj14qfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:12:00Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=216db027-e3a6-4027-9aa7-07031623c674,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "416d3421-181a-44dd-9e4c-438c8289541d", "address": "fa:16:3e:c0:ca:b6", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416d3421-18", "ovs_interfaceid": "416d3421-181a-44dd-9e4c-438c8289541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG os_vif [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap416d3421-18, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:25:58 user nova-compute[82009]: INFO os_vif [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=416d3421-181a-44dd-9e4c-438c8289541d,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416d3421-18')
Apr 11 18:25:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Deleting instance files /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674_del
Apr 11 18:25:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Deletion of /opt/stack/data/nova/instances/216db027-e3a6-4027-9aa7-07031623c674_del complete
Apr 11 18:25:58 user nova-compute[82009]: INFO nova.compute.manager [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 18:25:58 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:25:58 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Took 0.45 seconds to deallocate network for instance.
Apr 11 18:25:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-e3474776-7d9b-447e-8df9-a83226e7bc42 req-760be38d-dd98-49bc-ace5-80f361c5be86 service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-deleted-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:25:58 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:25:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:59 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Deleted allocations for instance 216db027-e3a6-4027-9aa7-07031623c674
Apr 11 18:25:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-3dce0e93-b64e-4566-b412-f123d6ac0343 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "216db027-e3a6-4027-9aa7-07031623c674" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:25:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Acquiring lock "216db027-e3a6-4027-9aa7-07031623c674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:25:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:25:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] Lock "216db027-e3a6-4027-9aa7-07031623c674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:25:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] No waiting events found dispatching network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:25:59 user nova-compute[82009]: WARNING nova.compute.manager [req-44e60764-fed8-41f8-9575-278a446131df req-b768be0a-a12e-4c2d-a8a6-974000784bfd service nova] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Received unexpected event network-vif-plugged-416d3421-181a-44dd-9e4c-438c8289541d for instance with vm_state deleted and task_state None.
Apr 11 18:26:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:26:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:26:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:26:00 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:26:01 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:26:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:26:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:02 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:04 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:05 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:07 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:26:07 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7953MB free_disk=26.31922149658203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:26:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:26:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:09 user nova-compute[82009]: INFO nova.compute.manager [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Unshelving
Apr 11 18:26:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'pci_requests' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'numa_topology' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:26:09 user nova-compute[82009]: INFO nova.compute.claims [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Claim successful on node user
Apr 11 18:26:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:26:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:10 user nova-compute[82009]: INFO nova.network.neutron [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating port 480464a5-6cf9-4a50-b936-059cceecb02d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing instance network info cache due to event network-changed-480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:26:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:26:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Creating image(s)
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'trusted_certs' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG nova.network.neutron [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Refreshing network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "62b39e59d35ba25b219d2e9cd244281371fa1def" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "62b39e59d35ba25b219d2e9cd244281371fa1def" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.part --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG nova.virt.images [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] 3998ea14-8f4e-4300-8d4a-9d26f9b09782 was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.part /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG nova.network.neutron [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updated VIF entry in instance network info cache for port 480464a5-6cf9-4a50-b936-059cceecb02d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG nova.network.neutron [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-25168f90-d086-4acb-ba62-40e239130276 req-8f6ad090-318f-4165-84dd-c3d63a719b12 service nova] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.part /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.converted" returned: 0 in 0.397s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "62b39e59d35ba25b219d2e9cd244281371fa1def" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237558.05091, 216db027-e3a6-4027-9aa7-07031623c674 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:26:13 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 216db027-e3a6-4027-9aa7-07031623c674] VM Stopped (Lifecycle Event)
Apr 11 18:26:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-2383afc0-fa36-4f69-83bd-09c782a37a45 None None] [instance: 216db027-e3a6-4027-9aa7-07031623c674] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "62b39e59d35ba25b219d2e9cd244281371fa1def" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "62b39e59d35ba25b219d2e9cd244281371fa1def" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def --force-share --output=json" returned: 0 in 0.189s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def,backing_fmt=raw /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def,backing_fmt=raw /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk 1073741824" returned: 0 in 0.071s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "62b39e59d35ba25b219d2e9cd244281371fa1def" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'migration_context' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Rebasing disk image.
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 -F raw /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 -F raw /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk" returned: 0 in 2.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Ensure instance console log exists: /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Start _get_guest_xml network_info=[{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e6309f1fd8d7d7b7e093baca9ec09158',container_format='bare',created_at=2023-04-11T18:24:17Z,direct_url=<?>,disk_format='qcow2',id=3998ea14-8f4e-4300-8d4a-9d26f9b09782,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1891122104-shelved',owner='0ed92c60cf9644b5ba5cefd2e92df3e0',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T18:24:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:26:15 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:26:15 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e6309f1fd8d7d7b7e093baca9ec09158',container_format='bare',created_at=2023-04-11T18:24:17Z,direct_url=<?>,disk_format='qcow2',id=3998ea14-8f4e-4300-8d4a-9d26f9b09782,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1891122104-shelved',owner='0ed92c60cf9644b5ba5cefd2e92df3e0',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T18:24:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891122104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891122104',id=29,image_ref='3998ea14-8f4e-4300-8d4a-9d26f9b09782',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1067458808',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-ejbm95nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member',shelved_at='2023-04-11T18:24:20.956372',shelved_host='user',shelved_image_id='3998ea14-8f4e-4300-8d4a-9d26f9b09782'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:26:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=17ecc1bd-12b1-4834-989b-607cf2eb41e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'pci_devices' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:26:15 user nova-compute[82009]:   <uuid>17ecc1bd-12b1-4834-989b-607cf2eb41e6</uuid>
Apr 11 18:26:15 user nova-compute[82009]:   <name>instance-0000001d</name>
Apr 11 18:26:15 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:26:15 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:26:15 user nova-compute[82009]:   <metadata>
Apr 11 18:26:15 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:26:15 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:26:15 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1891122104</nova:name>
Apr 11 18:26:15 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:26:15</nova:creationTime>
Apr 11 18:26:15 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:26:15 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:26:15 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:26:15 user nova-compute[82009]:       <nova:owner>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:user uuid="b724859b7dcd4fd29f17bbf991e9f6d4">tempest-AttachVolumeShelveTestJSON-93672654-project-member</nova:user>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:project uuid="0ed92c60cf9644b5ba5cefd2e92df3e0">tempest-AttachVolumeShelveTestJSON-93672654</nova:project>
Apr 11 18:26:15 user nova-compute[82009]:       </nova:owner>
Apr 11 18:26:15 user nova-compute[82009]:       <nova:root type="image" uuid="3998ea14-8f4e-4300-8d4a-9d26f9b09782"/>
Apr 11 18:26:15 user nova-compute[82009]:       <nova:ports>
Apr 11 18:26:15 user nova-compute[82009]:         <nova:port uuid="480464a5-6cf9-4a50-b936-059cceecb02d">
Apr 11 18:26:15 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 18:26:15 user nova-compute[82009]:         </nova:port>
Apr 11 18:26:15 user nova-compute[82009]:       </nova:ports>
Apr 11 18:26:15 user nova-compute[82009]:     </nova:instance>
Apr 11 18:26:15 user nova-compute[82009]:   </metadata>
Apr 11 18:26:15 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:26:15 user nova-compute[82009]:     <system>
Apr 11 18:26:15 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:26:15 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:26:15 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:26:15 user nova-compute[82009]:       <entry name="serial">17ecc1bd-12b1-4834-989b-607cf2eb41e6</entry>
Apr 11 18:26:15 user nova-compute[82009]:       <entry name="uuid">17ecc1bd-12b1-4834-989b-607cf2eb41e6</entry>
Apr 11 18:26:15 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:26:15 user nova-compute[82009]:     </system>
Apr 11 18:26:15 user nova-compute[82009]:   </sysinfo>
Apr 11 18:26:15 user nova-compute[82009]:   <os>
Apr 11 18:26:15 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:26:15 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:26:15 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:26:15 user nova-compute[82009]:   </os>
Apr 11 18:26:15 user nova-compute[82009]:   <features>
Apr 11 18:26:15 user nova-compute[82009]:     <acpi/>
Apr 11 18:26:15 user nova-compute[82009]:     <apic/>
Apr 11 18:26:15 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:26:15 user nova-compute[82009]:   </features>
Apr 11 18:26:15 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:26:15 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:26:15 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:26:15 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:26:15 user nova-compute[82009]:   </clock>
Apr 11 18:26:15 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:26:15 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:26:15 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:26:15 user nova-compute[82009]:   </cpu>
Apr 11 18:26:15 user nova-compute[82009]:   <devices>
Apr 11 18:26:15 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:26:15 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:26:15 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk"/>
Apr 11 18:26:15 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:26:15 user nova-compute[82009]:     </disk>
Apr 11 18:26:15 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:26:15 user nova-compute[82009]:       <mac address="fa:16:3e:5e:7d:dc"/>
Apr 11 18:26:15 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:26:15 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:26:15 user nova-compute[82009]:       <target dev="tap480464a5-6c"/>
Apr 11 18:26:15 user nova-compute[82009]:     </interface>
Apr 11 18:26:15 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:26:15 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/console.log" append="off"/>
Apr 11 18:26:15 user nova-compute[82009]:     </serial>
Apr 11 18:26:15 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:26:15 user nova-compute[82009]:     <video>
Apr 11 18:26:15 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:26:15 user nova-compute[82009]:     </video>
Apr 11 18:26:15 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:26:15 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:26:15 user nova-compute[82009]:     </rng>
Apr 11 18:26:15 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:26:15 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:26:15 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:26:15 user nova-compute[82009]:     </memballoon>
Apr 11 18:26:15 user nova-compute[82009]:   </devices>
Apr 11 18:26:15 user nova-compute[82009]: </domain>
Apr 11 18:26:15 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891122104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891122104',id=29,image_ref='3998ea14-8f4e-4300-8d4a-9d26f9b09782',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1067458808',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-ejbm95nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member',shelved_at='2023-04-11T18:24:20.956372',shelved_host='user',shelved_image_id='3998ea14-8f4e-4300-8d4a-9d26f9b09782'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:26:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=17ecc1bd-12b1-4834-989b-607cf2eb41e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG os_vif [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap480464a5-6c, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap480464a5-6c, col_values=(('external_ids', {'iface-id': '480464a5-6cf9-4a50-b936-059cceecb02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:7d:dc', 'vm-uuid': '17ecc1bd-12b1-4834-989b-607cf2eb41e6'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:15 user nova-compute[82009]: INFO os_vif [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c')
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:26:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] No VIF found with MAC fa:16:3e:5e:7d:dc, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:17 user nova-compute[82009]: WARNING nova.compute.manager [req-6ca42135-27cf-445a-83b5-b77f06326824 req-cea94682-4968-4dca-8c5d-b12d2b7e25ae service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237579.4310722, 17ecc1bd-12b1-4834-989b-607cf2eb41e6 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:26:19 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] VM Resumed (Lifecycle Event)
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:26:19 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance spawned successfully.
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:26:19 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237579.4370053, 17ecc1bd-12b1-4834-989b-607cf2eb41e6 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:26:19 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] VM Started (Lifecycle Event)
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:26:19 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ef104fdf-2a55-4f57-96ee-18a6d1062c91 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.186s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:19 user nova-compute[82009]: WARNING nova.compute.manager [req-aab03434-e135-48cb-80ff-d2b092889a80 req-c0470517-89f6-453e-9ecd-b1891c839ab9 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state active and task_state None.
Apr 11 18:26:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-changed-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Refreshing instance network info cache due to event network-changed-e146b0b2-5c30-4253-845d-2533c2961fcc. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:26:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Acquiring lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:26:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Acquired lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:26:28 user nova-compute[82009]: DEBUG nova.network.neutron [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Refreshing network info cache for port e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:26:29 user nova-compute[82009]: DEBUG nova.network.neutron [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updated VIF entry in instance network info cache for port e146b0b2-5c30-4253-845d-2533c2961fcc. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:26:29 user nova-compute[82009]: DEBUG nova.network.neutron [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updating instance_info_cache with network_info: [{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0849887f-7bee-4e3c-b213-312d88d8fae0 req-9f69f614-a92a-41d3-a102-56d0022175bf service nova] Releasing lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:26:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:26:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:26:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:31 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:26:31 user nova-compute[82009]: INFO nova.compute.claims [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Claim successful on node user
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:26:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:26:32 user nova-compute[82009]: INFO nova.virt.block_device [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Booting with volume eb51b2ca-fd24-41b8-bc39-fc11e130b55b at /dev/vda
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.policy [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ea51d683a9e45529a4eafc2359be9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49c5486b65e4d3eaab7c35fe84ac9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG os_brick.utils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e98b683-40e0-4257-88f5-a8401b36915b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea4dfd3-eb90-4ce5-852a-d9e7df72113c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ff42f-4890-40db-9efc-0c31e9c5898d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9a3c8e-2ea5-4b9f-b455-c03e34d1943e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:26:32 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:26:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c95a6e-107e-4de9-965d-7de62b56923f]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG os_brick.utils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:26:32 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating existing volume attachment record: 868bb6b5-c76f-42c2-8bc4-aea397f71b2d {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Successfully created port: d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Successfully updated port: d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-changed-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG nova.compute.manager [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Refreshing instance network info cache due to event network-changed-d983c712-087e-4bf3-a5c9-98ae1eea11ac. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:26:33 user nova-compute[82009]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG nova.network.neutron [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance network_info: |[{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Refreshing network info cache for port d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updated VIF entry in instance network info cache for port d983c712-087e-4bf3-a5c9-98ae1eea11ac. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG nova.network.neutron [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-193dd36a-1046-458f-a146-482ea72f3bad req-f668ea3e-7065-4efe-ae4f-863f5e542f26 service nova] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:26:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:26:36 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Creating image(s)
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Ensure instance console log exists: /opt/stack/data/nova/instances/d853cbf3-7869-416c-af88-0b01b498705a/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Start _get_guest_xml network_info=[{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '868bb6b5-c76f-42c2-8bc4-aea397f71b2d', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd853cbf3-7869-416c-af88-0b01b498705a', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'serial': 'eb51b2ca-fd24-41b8-bc39-fc11e130b55b'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:26:36 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:26:36 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:26:36 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:26:36 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:26:36 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eafe72b-e839-4506-8545-1a72b4435ed8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:26:36 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb30d35-5c80-4677-8bcb-95193fc58c7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b] added
Apr 11 18:26:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[465ba651-cf81-4be4-bf0c-20df480290e0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08e9471-a631-4fcc-8956-4e394c512f03]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DvasrCSQ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DvasrCSQ" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9739295-4b64-4651-9edb-05c377eb58da]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DvasrCSQ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[76534f74-aed6-44d5-baa1-076ab9d0a8f8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ff679-c1a7-4c8b-8061-feead8e1890f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0171720a-3d14-441c-a5e5-637ca37bffae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]
Apr 11 18:26:37 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.
Apr 11 18:26:37 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac95396-7fc1-4a37-819d-c439ebf1b92c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaadabd-1bbc-4672-bb86-15a94cb928d1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:26:37 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:26:37 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:26:37 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ac8ac-36d8-4db0-96b0-68a5e0d9b3c9]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:26:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26230346638333135', 'path': '/dev/sde'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230346638333135', 'path': '/dev/sde'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1486538402',display_name='tempest-ServerActionsTestJSON-server-1486538402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1486538402',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-5rr47ocf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:26:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=d853cbf3-7869-416c-af88-0b01b498705a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.objects.instance [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_devices' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:26:38 user nova-compute[82009]:   <uuid>d853cbf3-7869-416c-af88-0b01b498705a</uuid>
Apr 11 18:26:38 user nova-compute[82009]:   <name>instance-00000023</name>
Apr 11 18:26:38 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:26:38 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:26:38 user nova-compute[82009]:   <metadata>
Apr 11 18:26:38 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:26:38 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:26:38 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-1486538402</nova:name>
Apr 11 18:26:38 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:26:36</nova:creationTime>
Apr 11 18:26:38 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:26:38 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:26:38 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:26:38 user nova-compute[82009]:       <nova:owner>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:26:38 user nova-compute[82009]:       </nova:owner>
Apr 11 18:26:38 user nova-compute[82009]:       <nova:ports>
Apr 11 18:26:38 user nova-compute[82009]:         <nova:port uuid="d983c712-087e-4bf3-a5c9-98ae1eea11ac">
Apr 11 18:26:38 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 18:26:38 user nova-compute[82009]:         </nova:port>
Apr 11 18:26:38 user nova-compute[82009]:       </nova:ports>
Apr 11 18:26:38 user nova-compute[82009]:     </nova:instance>
Apr 11 18:26:38 user nova-compute[82009]:   </metadata>
Apr 11 18:26:38 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:26:38 user nova-compute[82009]:     <system>
Apr 11 18:26:38 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:26:38 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:26:38 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:26:38 user nova-compute[82009]:       <entry name="serial">d853cbf3-7869-416c-af88-0b01b498705a</entry>
Apr 11 18:26:38 user nova-compute[82009]:       <entry name="uuid">d853cbf3-7869-416c-af88-0b01b498705a</entry>
Apr 11 18:26:38 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:26:38 user nova-compute[82009]:     </system>
Apr 11 18:26:38 user nova-compute[82009]:   </sysinfo>
Apr 11 18:26:38 user nova-compute[82009]:   <os>
Apr 11 18:26:38 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:26:38 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:26:38 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:26:38 user nova-compute[82009]:   </os>
Apr 11 18:26:38 user nova-compute[82009]:   <features>
Apr 11 18:26:38 user nova-compute[82009]:     <acpi/>
Apr 11 18:26:38 user nova-compute[82009]:     <apic/>
Apr 11 18:26:38 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:26:38 user nova-compute[82009]:   </features>
Apr 11 18:26:38 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:26:38 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:26:38 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:26:38 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:26:38 user nova-compute[82009]:   </clock>
Apr 11 18:26:38 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:26:38 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:26:38 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:26:38 user nova-compute[82009]:   </cpu>
Apr 11 18:26:38 user nova-compute[82009]:   <devices>
Apr 11 18:26:38 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:26:38 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:26:38 user nova-compute[82009]:       <source dev="/dev/sde"/>
Apr 11 18:26:38 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:26:38 user nova-compute[82009]:       <serial>eb51b2ca-fd24-41b8-bc39-fc11e130b55b</serial>
Apr 11 18:26:38 user nova-compute[82009]:     </disk>
Apr 11 18:26:38 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:26:38 user nova-compute[82009]:       <mac address="fa:16:3e:bb:b5:bc"/>
Apr 11 18:26:38 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:26:38 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:26:38 user nova-compute[82009]:       <target dev="tapd983c712-08"/>
Apr 11 18:26:38 user nova-compute[82009]:     </interface>
Apr 11 18:26:38 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:26:38 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/d853cbf3-7869-416c-af88-0b01b498705a/console.log" append="off"/>
Apr 11 18:26:38 user nova-compute[82009]:     </serial>
Apr 11 18:26:38 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:26:38 user nova-compute[82009]:     <video>
Apr 11 18:26:38 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:26:38 user nova-compute[82009]:     </video>
Apr 11 18:26:38 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:26:38 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:26:38 user nova-compute[82009]:     </rng>
Apr 11 18:26:38 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:26:38 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:26:38 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:26:38 user nova-compute[82009]:     </memballoon>
Apr 11 18:26:38 user nova-compute[82009]:   </devices>
Apr 11 18:26:38 user nova-compute[82009]: </domain>
Apr 11 18:26:38 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1486538402',display_name='tempest-ServerActionsTestJSON-server-1486538402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1486538402',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-5rr47ocf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:26:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=d853cbf3-7869-416c-af88-0b01b498705a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG os_vif [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd983c712-08, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd983c712-08, col_values=(('external_ids', {'iface-id': 'd983c712-087e-4bf3-a5c9-98ae1eea11ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b5:bc', 'vm-uuid': 'd853cbf3-7869-416c-af88-0b01b498705a'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:38 user nova-compute[82009]: INFO os_vif [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08')
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:26:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:bb:b5:bc, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:39 user nova-compute[82009]: DEBUG nova.compute.manager [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:39 user nova-compute[82009]: WARNING nova.compute.manager [req-d0f851c5-f4e2-4494-9784-67303019fb30 req-13ed529c-8f4f-46a7-a7dd-aea3157a2483 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state building and task_state spawning.
Apr 11 18:26:40 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_power_states {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 88a15a03-3576-4b80-a11d-f7fd838429e9 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid b2175ccc-960d-4eca-8e41-3783cf28410b {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid ae5c052e-8a58-4adb-98b9-39f8a4c2a97c {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237601.5903866, d853cbf3-7869-416c-af88-0b01b498705a => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] VM Resumed (Lifecycle Event)
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance spawned successfully.
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237601.5943584, d853cbf3-7869-416c-af88-0b01b498705a => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] VM Started (Lifecycle Event)
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Took 4.89 seconds to spawn the instance on the hypervisor.
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Took 10.27 seconds to build instance.
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-56000c56-7a84-440f-a22b-d3ef02b61011 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.360s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "d853cbf3-7869-416c-af88-0b01b498705a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.768s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: INFO nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "d853cbf3-7869-416c-af88-0b01b498705a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:41 user nova-compute[82009]: WARNING nova.compute.manager [req-5e74724f-cc0c-4630-8d3e-dd5487282bae req-ec54dd16-a733-4204-9e95-199469a794c7 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state active and task_state None.
Apr 11 18:26:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:47 user nova-compute[82009]: INFO nova.compute.manager [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Terminating instance
Apr 11 18:26:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-94cf8282-474d-43e4-b1b2-a7a62f326d36 req-d77a3029-6b4c-41a7-864a-7757b4d42d42 service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-unplugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Instance destroyed successfully.
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lazy-loading 'resources' on Instance uuid 253a1b67-06b0-4308-a2fc-78f36cda0ab8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1892408024',display_name='tempest-ServerRescueNegativeTestJSON-server-1892408024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1892408024',id=1,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c10b5a531bbc41d680d137a766a8b2d9',ramdisk_id='',reservation_id='r-xt0f3of7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-223229619',owner_user_name='tempest-ServerRescueNegativeTestJSON-223229619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:16:42Z,user_data=None,user_id='908e0b5a1ce14f5cb636eda79ac77f7b',uuid=253a1b67-06b0-4308-a2fc-78f36cda0ab8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converting VIF {"id": "3097aae4-0511-4a73-883d-3366bfa914b7", "address": "fa:16:3e:d9:29:78", "network": {"id": "0c782c31-14df-4b47-a7bc-3191698e4825", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-283181811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c10b5a531bbc41d680d137a766a8b2d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3097aae4-05", "ovs_interfaceid": "3097aae4-0511-4a73-883d-3366bfa914b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG os_vif [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3097aae4-05, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:26:48 user nova-compute[82009]: INFO os_vif [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:29:78,bridge_name='br-int',has_traffic_filtering=True,id=3097aae4-0511-4a73-883d-3366bfa914b7,network=Network(0c782c31-14df-4b47-a7bc-3191698e4825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3097aae4-05')
Apr 11 18:26:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Deleting instance files /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8_del
Apr 11 18:26:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Deletion of /opt/stack/data/nova/instances/253a1b67-06b0-4308-a2fc-78f36cda0ab8_del complete
Apr 11 18:26:48 user nova-compute[82009]: INFO nova.compute.manager [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 18:26:48 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:26:48 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:49 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Took 0.46 seconds to deallocate network for instance.
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:49 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Deleted allocations for instance 253a1b67-06b0-4308-a2fc-78f36cda0ab8
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:49 user nova-compute[82009]: INFO nova.compute.manager [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Terminating instance
Apr 11 18:26:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-055f91f4-9d35-40b4-b8da-a81d5cbeabb4 tempest-ServerRescueNegativeTestJSON-223229619 tempest-ServerRescueNegativeTestJSON-223229619-project-member] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:26:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Acquiring lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Lock "253a1b67-06b0-4308-a2fc-78f36cda0ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] No waiting events found dispatching network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:50 user nova-compute[82009]: WARNING nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received unexpected event network-vif-plugged-3097aae4-0511-4a73-883d-3366bfa914b7 for instance with vm_state deleted and task_state None.
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Received event network-vif-deleted-3097aae4-0511-4a73-883d-3366bfa914b7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-vif-unplugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] No waiting events found dispatching network-vif-unplugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-a120d5b4-0454-4b91-ae26-ea1bf16e601e req-4fa858f3-52d9-4d89-bffb-5204d7ab84ec service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-vif-unplugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:26:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Instance destroyed successfully.
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.objects.instance [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'resources' on Instance uuid ae5c052e-8a58-4adb-98b9-39f8a4c2a97c {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-473236277',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-473236277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-473236277',id=33,image_ref='dc2a2ec9-eac7-4c6e-a001-0159eb253657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-at4ruoc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1768143130',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:25:15Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=ae5c052e-8a58-4adb-98b9-39f8a4c2a97c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "address": "fa:16:3e:59:98:22", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa719a1-80", "ovs_interfaceid": "6fa719a1-80b1-4fde-8d1c-09d119fccdb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_vif [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fa719a1-80, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:50 user nova-compute[82009]: INFO os_vif [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:98:22,bridge_name='br-int',has_traffic_filtering=True,id=6fa719a1-80b1-4fde-8d1c-09d119fccdb9,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa719a1-80')
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlQaVOeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:26:50 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d9df6-80ec-4681-843d-1150bdfbb0c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:26:50 user nova-compute[82009]: No targets found.
Apr 11 18:26:50 user nova-compute[82009]: iSNS:
Apr 11 18:26:50 user nova-compute[82009]: No targets found.
Apr 11 18:26:50 user nova-compute[82009]: STATIC:
Apr 11 18:26:50 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014
Apr 11 18:26:50 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:26:50 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:26:50 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:26:50 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:26:50 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:26:50 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:26:50 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:26:50 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:26:50 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:26:50 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:26:50 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:26:50 user nova-compute[82009]: FIRMWARE:
Apr 11 18:26:50 user nova-compute[82009]: No targets found.
Apr 11 18:26:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:26:50 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:26:50 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0325c10-b6a3-459d-a199-e8d3d2a0f2fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cf3af4-7ebb-4a93-83a0-fec89b08afb7]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:26:50 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:26:50 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:26:50 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:26:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:26:50 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:26:50 user nova-compute[82009]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 (non-flash)
Apr 11 18:26:50 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:26:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e024dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0fae76-1afb-429a-88b2-3b52dbf42120]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c2120-8f14-4b08-b955-8f81a3c048ba]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc91711-09c7-4acd-9009-4825e579d0ce]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4244f3f-cefd-4bc5-a0cb-a2b061de71af]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e69cdaea', '/dev/disk/by-id/scsi-1SCST_BIOe69cdaea-2fdfb22bb0467aca', '/dev/disk/by-id/scsi-23266646662323262') {{(pid=92248) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 18:26:50 user nova-compute[82009]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e69cdaea
Apr 11 18:26:50 user nova-compute[82009]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe69cdaea-2fdfb22bb0467aca
Apr 11 18:26:50 user nova-compute[82009]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23266646662323262
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebf5bb6-fe17-4a81-8602-9ac1239b8266]: (4, None) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2c0ea5-8c40-4ffe-bebd-c975eb0db458]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12282a-3575-4960-b37f-5d4bd235802d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260]
Apr 11 18:26:50 user nova-compute[82009]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014, portal: 172.16.0.220,3260] successful.
Apr 11 18:26:50 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78afcf33-7276-41f4-a849-cdf6ce2d6014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2325a8f2-790f-4aaf-9e73-f8dc4dd65bf9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== disconnect_volume: return (335ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:26:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Deleting instance files /opt/stack/data/nova/instances/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c_del
Apr 11 18:26:50 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Deletion of /opt/stack/data/nova/instances/ae5c052e-8a58-4adb-98b9-39f8a4c2a97c_del complete
Apr 11 18:26:50 user nova-compute[82009]: INFO nova.compute.manager [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 18:26:50 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:26:50 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:26:51 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:26:51 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Took 0.45 seconds to deallocate network for instance.
Apr 11 18:26:52 user nova-compute[82009]: INFO nova.compute.manager [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 18:26:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Deleting volume: 78afcf33-7276-41f4-a849-cdf6ce2d6014 {{(pid=82009) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Acquiring lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] No waiting events found dispatching network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:26:52 user nova-compute[82009]: WARNING nova.compute.manager [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received unexpected event network-vif-plugged-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 for instance with vm_state deleted and task_state None.
Apr 11 18:26:52 user nova-compute[82009]: DEBUG nova.compute.manager [req-ed1b1001-095b-4be7-b173-987ec7105dbd req-435c0c42-721d-42db-9446-db66c1a00b01 service nova] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Received event network-vif-deleted-6fa719a1-80b1-4fde-8d1c-09d119fccdb9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:52 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Deleted allocations for instance ae5c052e-8a58-4adb-98b9-39f8a4c2a97c
Apr 11 18:26:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d89256b6-30ad-4b5a-8664-07fe9686aa28 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "ae5c052e-8a58-4adb-98b9-39f8a4c2a97c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.205s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:26:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:26:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:02 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:02 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:27:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:27:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:27:02 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:27:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [{"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:27:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-17ecc1bd-12b1-4834-989b-607cf2eb41e6" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:27:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:27:03 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237608.5455828, 253a1b67-06b0-4308-a2fc-78f36cda0ab8 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:27:03 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] VM Stopped (Lifecycle Event)
Apr 11 18:27:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-6e6e0e69-b88d-43f4-acdb-1d6ed7fcba3a None None] [instance: 253a1b67-06b0-4308-a2fc-78f36cda0ab8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237610.478248, ae5c052e-8a58-4adb-98b9-39f8a4c2a97c => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:27:05 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] VM Stopped (Lifecycle Event)
Apr 11 18:27:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-acbe6b2c-4c9b-4dc2-af23-b292db74f348 None None] [instance: ae5c052e-8a58-4adb-98b9-39f8a4c2a97c] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:05 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:07 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:27:07 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:27:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=7971MB free_disk=26.318775177001953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d853cbf3-7869-416c-af88-0b01b498705a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:27:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-changed-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG nova.compute.manager [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Refreshing instance network info cache due to event network-changed-fab46756-563a-4dbb-bbb5-b2b4722e7a57. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Acquiring lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Acquired lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Refreshing network info cache for port fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updated VIF entry in instance network info cache for port fab46756-563a-4dbb-bbb5-b2b4722e7a57. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updating instance_info_cache with network_info: [{"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:27:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2195b9af-c4bb-4850-aaa2-d9b9f66d4a97 req-da0a6fad-bc18-4112-95c3-12452cfee44c service nova] Releasing lock "refresh_cache-bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:11 user nova-compute[82009]: INFO nova.compute.manager [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attaching volume 2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 to /dev/vdb
Apr 11 18:27:11 user nova-compute[82009]: DEBUG os_brick.utils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac855ad-0b69-4f43-9469-0569a221be12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[162def9b-b3ea-4d4d-8442-60508a86b8e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5d853-8822-4edb-8f74-12be9a5d5ef2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1e91f-e32d-46ce-a73f-6ff4ec0947c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:27:11 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:27:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544b1d4-dd5d-48fb-bdec-fa826b7a0086]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG os_brick.utils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:11 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updating existing volume attachment record: ddbce1cc-0f86-4fdb-866b-c9e79f926443 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:27:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:27:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPpuDkKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:16 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:16 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:16 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd9246c-eaba-4770-97c7-df6de42d54ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:27:16 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a31b40-7ecd-424a-b803-07ef0e0f2b7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04] added
Apr 11 18:27:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bda1be-a959-453e-87c1-479346ba7997]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ad352d-828d-465a-b6ac-803303d9ec8c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPpuDkKB {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPpuDkKB" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3042aa-0d8f-41bb-bd31-85dea2615f24]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPpuDkKB'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1cd050-91cc-490a-8ae2-b4f221cfc96a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[458de4c8-b065-4ccb-be87-8e66c193bc3a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0f759-8fca-4983-80c7-080a0e0a2d96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260]
Apr 11 18:27:16 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260] successful.
Apr 11 18:27:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32aea3-a892-4cad-846a-b774a9c9ae0d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c0f03c-e884-4928-81d7-9ddb59a21082]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:16 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:16 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b468a3d-58a3-4c7d-a07e-22f96d3290c9]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:27:16 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPpuDkKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26239313964373164', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239313964373164', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG nova.objects.instance [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:27:17 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:27:17 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:27:17 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:27:17 user nova-compute[82009]:   <serial>2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04</serial>
Apr 11 18:27:17 user nova-compute[82009]: </disk>
Apr 11 18:27:17 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No VIF found with MAC fa:16:3e:08:37:7e, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:27:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64575f68-0c73-400b-ac99-7c6ea65962f0 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.170s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:20 user nova-compute[82009]: INFO nova.compute.manager [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attaching volume e77769cb-0585-4e4a-a83c-38d84ba00811 to /dev/vdc
Apr 11 18:27:20 user nova-compute[82009]: DEBUG os_brick.utils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac1b75-f415-4900-abde-b48c193baf83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff25f3-e02f-4192-810d-f9558707b875]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[11219926-b99b-401c-93df-13866d80ee6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92aadc6-16d0-48f7-a1cd-3f424f4e6a87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:27:20 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:27:20 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e7286-dee1-464a-9fcd-444e71ca2b97]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG os_brick.utils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updating existing volume attachment record: d49e150d-1d9c-4f4e-b9ba-6ee9e3f749a4 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:27:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyrqefwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:24 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:24 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:24 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513f37d-41f7-460d-9f8a-4cacb1cc3f7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:27:24 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa75cb39-fc96-408d-af61-1d6699408a6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811] added
Apr 11 18:27:24 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07df8da-703b-451b-ad88-d56eed371c64]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb82ae40-30bf-4587-9d90-ac4e7af8efe3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyrqefwQ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyrqefwQ" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[59629656-4ab6-428b-a8d9-a948cc105d95]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xyrqefwQ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab196d-3545-4bdf-aaf2-1c1cdd47b638]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[187cb3ee-0a29-44e7-b282-e90da82c5e07]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df43df-18bf-41e2-898e-3c8784b20d4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260]
Apr 11 18:27:24 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260] successful.
Apr 11 18:27:24 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a98340-9a83-472f-a5e8-a99840c39726]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9788f2c7-9fd8-4f76-9abe-329f84d9a066]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)
Apr 11 18:27:24 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c252c098-e2a4-4a01-ad41-5c05951b9a21]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:27:24 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyrqefwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:27:25 user nova-compute[82009]: INFO nova.compute.manager [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Unrescuing
Apr 11 18:27:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'flavor' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23337346238366136', 'path': '/dev/sdf'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337346238366136', 'path': '/dev/sdf'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:27:25 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:27:25 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:27:25 user nova-compute[82009]:   <target dev="vdc" bus="virtio"/>
Apr 11 18:27:25 user nova-compute[82009]:   <serial>e77769cb-0585-4e4a-a83c-38d84ba00811</serial>
Apr 11 18:27:25 user nova-compute[82009]: </disk>
Apr 11 18:27:25 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:27:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:26 user nova-compute[82009]: WARNING nova.compute.manager [req-9d7ee418-9c6d-466f-ba0a-9efe607c7655 req-a31b52c4-51b3-48ec-9d84-5a568b58b246 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:27:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] No VIF found with MAC fa:16:3e:08:37:7e, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c843c314-0469-4468-92e9-9c721ab69222 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance destroyed successfully.
Apr 11 18:27:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:26 user nova-compute[82009]: INFO nova.compute.manager [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Detaching volume 2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04
Apr 11 18:27:26 user nova-compute[82009]: INFO nova.virt.block_device [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attempting to driver detach volume 2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 from mountpoint /dev/vdb
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Attempting to detach device vdb from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:27:26 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:27:26 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:27:26 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:27:26 user nova-compute[82009]:   <serial>2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04</serial>
Apr 11 18:27:26 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:27:26 user nova-compute[82009]: </disk>
Apr 11 18:27:26 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:27:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully detached device vdb from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the persistent domain config.
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:27:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:27:26 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:27:26 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:27:26 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:27:26 user nova-compute[82009]:   <serial>2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04</serial>
Apr 11 18:27:26 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:27:26 user nova-compute[82009]: </disk>
Apr 11 18:27:26 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237647.4757307, bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:27:27 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully detached device vdb from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the live domain config.
Apr 11 18:27:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPpuDkKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:27 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad004e24-a6b1-4d58-90a2-6a51ddb3c5ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:27:27 user nova-compute[82009]: No targets found.
Apr 11 18:27:27 user nova-compute[82009]: iSNS:
Apr 11 18:27:27 user nova-compute[82009]: No targets found.
Apr 11 18:27:27 user nova-compute[82009]: STATIC:
Apr 11 18:27:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:27:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:27:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:27:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04
Apr 11 18:27:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811
Apr 11 18:27:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:27 user nova-compute[82009]: FIRMWARE:
Apr 11 18:27:27 user nova-compute[82009]: No targets found.
Apr 11 18:27:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:27:27 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:27:27 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661af9e-9ed8-43cb-a39d-232a332b7187]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a2308-df01-410c-984e-bc884a903424]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)
Apr 11 18:27:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8157520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03acb78-b4cb-4931-9592-3811fc4728c2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0ee58-7551-46a2-9943-48bebc5119a2]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d4792-51d0-4de9-aaf4-6b4a5267f9c8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cc6705-afdf-41c8-a172-c23b1777d57b]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[369cdec9-71d7-4c24-b436-46ee18279dd6]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[93adc124-e138-4988-b2bb-eb0e7ce25ce7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260]
Apr 11 18:27:27 user nova-compute[82009]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04, portal: 172.16.0.220,3260] successful.
Apr 11 18:27:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b4b4ca2-7eb0-4e46-ae73-9d2f44732f04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d999e6a9-623e-47bf-8d09-8beceb235f76]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== disconnect_volume: return (337ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:28 user nova-compute[82009]: WARNING nova.compute.manager [req-16c981fb-d06d-4efd-88f3-a0fe2d4b5e85 req-159e5798-cc3b-4f1a-8693-ea780641aed8 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:27:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c3fd4af8-3d00-4f57-a587-be30fcba163b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:29 user nova-compute[82009]: INFO nova.compute.manager [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Detaching volume e77769cb-0585-4e4a-a83c-38d84ba00811
Apr 11 18:27:29 user nova-compute[82009]: INFO nova.virt.block_device [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Attempting to driver detach volume e77769cb-0585-4e4a-a83c-38d84ba00811 from mountpoint /dev/vdc
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Attempting to detach device vdc from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:27:29 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:27:29 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:27:29 user nova-compute[82009]:   <target dev="vdc" bus="virtio"/>
Apr 11 18:27:29 user nova-compute[82009]:   <serial>e77769cb-0585-4e4a-a83c-38d84ba00811</serial>
Apr 11 18:27:29 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 18:27:29 user nova-compute[82009]: </disk>
Apr 11 18:27:29 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:27:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully detached device vdc from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the persistent domain config.
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:27:29 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:27:29 user nova-compute[82009]:   <source dev="/dev/sdf"/>
Apr 11 18:27:29 user nova-compute[82009]:   <target dev="vdc" bus="virtio"/>
Apr 11 18:27:29 user nova-compute[82009]:   <serial>e77769cb-0585-4e4a-a83c-38d84ba00811</serial>
Apr 11 18:27:29 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 18:27:29 user nova-compute[82009]: </disk>
Apr 11 18:27:29 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681237649.7391326, bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:27:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully detached device vdc from instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 from the live domain config.
Apr 11 18:27:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyrqefwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:29 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa07d614-f987-4424-912b-8eca3943452e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:27:29 user nova-compute[82009]: No targets found.
Apr 11 18:27:29 user nova-compute[82009]: iSNS:
Apr 11 18:27:29 user nova-compute[82009]: No targets found.
Apr 11 18:27:29 user nova-compute[82009]: STATIC:
Apr 11 18:27:29 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:27:29 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:29 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:29 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:27:29 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:29 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:29 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:27:29 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:29 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:29 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811
Apr 11 18:27:29 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:29 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:29 user nova-compute[82009]: FIRMWARE:
Apr 11 18:27:29 user nova-compute[82009]: No targets found.
Apr 11 18:27:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:27:29 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:27:29 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca78e7d-9cc3-4e6f-83c4-a9a6aa0244d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[daac9313-b007-4768-9344-969c8b0b7718]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:29 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:29 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:29 user nova-compute[82009]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)
Apr 11 18:27:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:29 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:29 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:29 user nova-compute[82009]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 (non-flash)
Apr 11 18:27:29 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e011cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811'): ({'sdf'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Removing single pathed devices sdf {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b497f0-19db-4f29-bd7a-b3140487c392]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda9a2de-4300-4e58-9206-e8247fcfa118]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Flushing IO for device /dev/sdf {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15391aba-e7eb-4373-b2c5-124590b64000]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19bd74-0745-476d-a27f-aa86d843162f]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[11357d87-be2b-4c2a-90e6-3cdbfa0ba16e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cbbcfb-7b7d-490f-8bde-69a8b318cde2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260]
Apr 11 18:27:30 user nova-compute[82009]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811, portal: 172.16.0.220,3260] successful.
Apr 11 18:27:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77769cb-0585-4e4a-a83c-38d84ba00811 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c4ba1-2db8-4681-bf2a-c6de4dcc502e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] <== disconnect_volume: return (349ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:30 user nova-compute[82009]: WARNING nova.compute.manager [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:30 user nova-compute[82009]: WARNING nova.compute.manager [req-e64fda23-35d7-4033-908d-284d07e911f8 req-a54f6000-8fc2-4624-bb15-67e2d8698cea service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for bef10824-ced0-49d5-934a-c509ab119cbf due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237650.2197824, bef10824-ced0-49d5-934a-c509ab119cbf => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:27:30 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Resumed (Lifecycle Event)
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-978652a2-b848-4b9a-858d-c9c7ca11abf9 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:27:30 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237650.221473, bef10824-ced0-49d5-934a-c509ab119cbf => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:27:30 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Started (Lifecycle Event)
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'flavor' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7952166b-69f5-4628-aa96-cc49430d5b55 tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:31 user nova-compute[82009]: INFO nova.compute.manager [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Terminating instance
Apr 11 18:27:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-vif-unplugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] No waiting events found dispatching network-vif-unplugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-47418c8e-867a-4ef8-96de-a86753f6fc49 req-9a38001f-fabc-478f-b7c5-1e6040a97460 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-vif-unplugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Instance destroyed successfully.
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lazy-loading 'resources' on Instance uuid bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1211420081',display_name='tempest-AttachVolumeTestJSON-server-1211420081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1211420081',id=34,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqSkOsVWWiQJY+4Uhu/FVlYzwpA9r4NiOcAw/vTuyzs+NADfEQsbFTqqlwK/uPXN4CA0MSgtJUJtml4jJTgDvkQuRFevMxDr03QFffyWHyb3yDt1o4/Scj9arSvVLcxfA==',key_name='tempest-keypair-1800185275',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d77a56502d9848a3842c938d5adc8c51',ramdisk_id='',reservation_id='r-ofvsa9aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-369540173',owner_user_name='tempest-AttachVolumeTestJSON-369540173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b852c50aeb514b7fbe5a9b72e8bbdc14',uuid=bba677b9-2c44-4f9c-a7d9-7e9098c98fb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converting VIF {"id": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "address": "fa:16:3e:08:37:7e", "network": {"id": "b10563fa-e007-4ce1-9088-f81d415728c4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-183247933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d77a56502d9848a3842c938d5adc8c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab46756-56", "ovs_interfaceid": "fab46756-563a-4dbb-bbb5-b2b4722e7a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG os_vif [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfab46756-56, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:32 user nova-compute[82009]: INFO os_vif [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:37:7e,bridge_name='br-int',has_traffic_filtering=True,id=fab46756-563a-4dbb-bbb5-b2b4722e7a57,network=Network(b10563fa-e007-4ce1-9088-f81d415728c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab46756-56')
Apr 11 18:27:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Deleting instance files /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8_del
Apr 11 18:27:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Deletion of /opt/stack/data/nova/instances/bba677b9-2c44-4f9c-a7d9-7e9098c98fb8_del complete
Apr 11 18:27:32 user nova-compute[82009]: INFO nova.compute.manager [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 18:27:32 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:27:32 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:27:33 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:27:33 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Took 0.78 seconds to deallocate network for instance.
Apr 11 18:27:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:33 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:27:33 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:27:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:33 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Deleted allocations for instance bba677b9-2c44-4f9c-a7d9-7e9098c98fb8
Apr 11 18:27:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-444247c5-88c6-4f96-87cb-0ee1973c3a5b tempest-AttachVolumeTestJSON-369540173 tempest-AttachVolumeTestJSON-369540173-project-member] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Acquiring lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] Lock "bba677b9-2c44-4f9c-a7d9-7e9098c98fb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] No waiting events found dispatching network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:34 user nova-compute[82009]: WARNING nova.compute.manager [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received unexpected event network-vif-plugged-fab46756-563a-4dbb-bbb5-b2b4722e7a57 for instance with vm_state deleted and task_state None.
Apr 11 18:27:34 user nova-compute[82009]: DEBUG nova.compute.manager [req-5550ca7d-482d-4360-ade4-f02ec51ad074 req-3168c3bf-b77c-481d-95db-b2c1a80431a4 service nova] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Received event network-vif-deleted-fab46756-563a-4dbb-bbb5-b2b4722e7a57 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:41 user nova-compute[82009]: INFO nova.compute.manager [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Terminating instance
Apr 11 18:27:41 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-vif-unplugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] No waiting events found dispatching network-vif-unplugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-6c920cec-baed-4cf1-b834-b22f99faaa89 req-76be3c5d-a2b8-46ff-a595-09a65e384640 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-vif-unplugged-1f623093-dd91-4d96-b18d-81470e690172 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:27:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Instance destroyed successfully.
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'resources' on Instance uuid 88a15a03-3576-4b80-a11d-f7fd838429e9 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2036153281',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2036153281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2036153281',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-atoed6r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:23:16Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=88a15a03-3576-4b80-a11d-f7fd838429e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "1f623093-dd91-4d96-b18d-81470e690172", "address": "fa:16:3e:e9:3d:ee", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f623093-dd", "ovs_interfaceid": "1f623093-dd91-4d96-b18d-81470e690172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_vif [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f623093-dd, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:42 user nova-compute[82009]: INFO os_vif [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=1f623093-dd91-4d96-b18d-81470e690172,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f623093-dd')
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlUqJsSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:27:42 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6e2aac-05ca-4493-98d4-f492eae0600b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:27:42 user nova-compute[82009]: No targets found.
Apr 11 18:27:42 user nova-compute[82009]: iSNS:
Apr 11 18:27:42 user nova-compute[82009]: No targets found.
Apr 11 18:27:42 user nova-compute[82009]: STATIC:
Apr 11 18:27:42 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:27:42 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:42 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:42 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14
Apr 11 18:27:42 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:42 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:42 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:27:42 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:27:42 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:27:42 user nova-compute[82009]: FIRMWARE:
Apr 11 18:27:42 user nova-compute[82009]: No targets found.
Apr 11 18:27:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:27:42 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:27:42 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c3011-249a-4c1d-ace6-00d04e622868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6825c04-316a-487f-bf70-f1278cdae9be]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:42 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:42 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 (non-flash)
Apr 11 18:27:42 user nova-compute[82009]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:27:42 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:27:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6b2c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ed4c77-1e1c-48b1-9c83-c86d0e8c0e43]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3627239-4a95-453e-ac9a-3f48faa8ebd7]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92f0a3d-01f1-491b-889e-c9a07220bfee]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[01299b24-c24b-479c-b6a1-5f5a440d9042]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731d457-114c-46af-80e8-25c4e0df8a50]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e26f696-4261-4a56-bd2a-142492b6cf09]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260]
Apr 11 18:27:42 user nova-compute[82009]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14, portal: 172.16.0.220,3260] successful.
Apr 11 18:27:42 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94331799-c0ed-4258-962d-d21d01e8de14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85179345-396c-4b6a-aa6b-9142030636ec]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== disconnect_volume: return (333ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:27:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Deleting instance files /opt/stack/data/nova/instances/88a15a03-3576-4b80-a11d-f7fd838429e9_del
Apr 11 18:27:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Deletion of /opt/stack/data/nova/instances/88a15a03-3576-4b80-a11d-f7fd838429e9_del complete
Apr 11 18:27:42 user nova-compute[82009]: INFO nova.compute.manager [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 11 18:27:42 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:27:42 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Took 0.44 seconds to deallocate network for instance.
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-vif-deleted-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:42 user nova-compute[82009]: INFO nova.compute.manager [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Neutron deleted interface 1f623093-dd91-4d96-b18d-81470e690172; detaching it from the instance and deleting it from the info cache
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:27:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-dc359b2e-06c0-42f0-9498-20b39aa0ee5e req-f5244022-202a-4f31-a629-a73da9f99c58 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Detach interface failed, port_id=1f623093-dd91-4d96-b18d-81470e690172, reason: Instance 88a15a03-3576-4b80-a11d-f7fd838429e9 could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received event network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Acquiring lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] No waiting events found dispatching network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:27:43 user nova-compute[82009]: WARNING nova.compute.manager [req-49af9ab8-c30a-49e7-b09a-474845837a77 req-b7daabb2-a1d6-491a-b2d6-715776639000 service nova] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Received unexpected event network-vif-plugged-1f623093-dd91-4d96-b18d-81470e690172 for instance with vm_state active and task_state deleting.
Apr 11 18:27:43 user nova-compute[82009]: INFO nova.compute.manager [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Took 0.78 seconds to detach 1 volumes for instance.
Apr 11 18:27:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Deleting volume: 94331799-c0ed-4258-962d-d21d01e8de14 {{(pid=82009) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:44 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:27:44 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:27:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:44 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Deleted allocations for instance 88a15a03-3576-4b80-a11d-f7fd838429e9
Apr 11 18:27:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e4fe3149-be0c-482e-a54a-5d8c0dc28fe9 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "88a15a03-3576-4b80-a11d-f7fd838429e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:47 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237652.6606958, bba677b9-2c44-4f9c-a7d9-7e9098c98fb8 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:27:47 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] VM Stopped (Lifecycle Event)
Apr 11 18:27:47 user nova-compute[82009]: DEBUG nova.compute.manager [None req-13ca8d49-3cde-4227-975d-475c28861aac None None] [instance: bba677b9-2c44-4f9c-a7d9-7e9098c98fb8] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237662.0136123, 88a15a03-3576-4b80-a11d-f7fd838429e9 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:27:57 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] VM Stopped (Lifecycle Event)
Apr 11 18:27:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4cb628fc-50f2-4e96-9f9a-b02a5c2533ab None None] [instance: 88a15a03-3576-4b80-a11d-f7fd838429e9] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:27:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:27:59 user nova-compute[82009]: INFO nova.compute.manager [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Terminating instance
Apr 11 18:27:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:27:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-unplugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-unplugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-21ffd0f5-df99-45f5-af61-70041ff26a69 req-cc109fbf-7034-4f85-b92e-0592b5ace950 service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-unplugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:28:00 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Instance destroyed successfully.
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lazy-loading 'resources' on Instance uuid 17ecc1bd-12b1-4834-989b-607cf2eb41e6 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T18:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891122104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891122104',id=29,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4UT1jM+S2X9MyxQqF+Oy/72JleNBxRkmuHwrvJGSFpmjQkv23wckhLJZtjOdqaJJ0Z7NI49IR6xFA4+Vc5wRw9Eh60mBoafHGjPt+olG1clsJEASk4rQXvE+RJNyQ5AQ==',key_name='tempest-keypair-1067458808',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ed92c60cf9644b5ba5cefd2e92df3e0',ramdisk_id='',reservation_id='r-ejbm95nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-93672654',owner_user_name='tempest-AttachVolumeShelveTestJSON-93672654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b724859b7dcd4fd29f17bbf991e9f6d4',uuid=17ecc1bd-12b1-4834-989b-607cf2eb41e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converting VIF {"id": "480464a5-6cf9-4a50-b936-059cceecb02d", "address": "fa:16:3e:5e:7d:dc", "network": {"id": "bde85ee5-a5c4-4773-b4dd-b58d44a7f92a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1428393338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ed92c60cf9644b5ba5cefd2e92df3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480464a5-6c", "ovs_interfaceid": "480464a5-6cf9-4a50-b936-059cceecb02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG os_vif [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap480464a5-6c, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:28:00 user nova-compute[82009]: INFO os_vif [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:7d:dc,bridge_name='br-int',has_traffic_filtering=True,id=480464a5-6cf9-4a50-b936-059cceecb02d,network=Network(bde85ee5-a5c4-4773-b4dd-b58d44a7f92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480464a5-6c')
Apr 11 18:28:00 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Deleting instance files /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6_del
Apr 11 18:28:00 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Deletion of /opt/stack/data/nova/instances/17ecc1bd-12b1-4834-989b-607cf2eb41e6_del complete
Apr 11 18:28:00 user nova-compute[82009]: INFO nova.compute.manager [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 18:28:00 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:28:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:01 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:01 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Took 0.78 seconds to deallocate network for instance.
Apr 11 18:28:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-56ddeda1-9a82-4010-bed1-411e8d0af87f req-f1a66621-c2f4-4a96-9200-f6952fddb6bd service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-deleted-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:01 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:28:01 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:28:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:01 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Deleted allocations for instance 17ecc1bd-12b1-4834-989b-607cf2eb41e6
Apr 11 18:28:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-737b4598-29b9-4b93-81b1-16f3791d5d58 tempest-AttachVolumeShelveTestJSON-93672654 tempest-AttachVolumeShelveTestJSON-93672654-project-member] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Acquiring lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] Lock "17ecc1bd-12b1-4834-989b-607cf2eb41e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] No waiting events found dispatching network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:02 user nova-compute[82009]: WARNING nova.compute.manager [req-a0342e02-5236-4d30-a094-b5dcbd5d06d0 req-dec121ba-1f6f-4883-b8d4-e49b2b61316b service nova] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Received unexpected event network-vif-plugged-480464a5-6cf9-4a50-b936-059cceecb02d for instance with vm_state deleted and task_state None.
Apr 11 18:28:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:28:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:28:04 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:04 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:28:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:06 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:28:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:28:08 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:28:08 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8357MB free_disk=26.347633361816406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d853cbf3-7869-416c-af88-0b01b498705a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:28:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:28:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237680.549395, 17ecc1bd-12b1-4834-989b-607cf2eb41e6 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:28:15 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] VM Stopped (Lifecycle Event)
Apr 11 18:28:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-54437200-839b-4274-94f2-449435d7cfdd None None] [instance: 17ecc1bd-12b1-4834-989b-607cf2eb41e6] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:28:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-changed-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Refreshing instance network info cache due to event network-changed-e146b0b2-5c30-4253-845d-2533c2961fcc. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Acquiring lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Acquired lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Refreshing network info cache for port e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updated VIF entry in instance network info cache for port e146b0b2-5c30-4253-845d-2533c2961fcc. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updating instance_info_cache with network_info: [{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b45b9d9-92b9-41b7-bc46-98e5822ce5ef req-59011169-426e-40c5-bd55-ebfc7b181a01 service nova] Releasing lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Stashing vm_state: active {{(pid=82009) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_requests' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:28:25 user nova-compute[82009]: INFO nova.compute.claims [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Claim successful on node user
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'pci_devices' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-changed-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Refreshing instance network info cache due to event network-changed-d983c712-087e-4bf3-a5c9-98ae1eea11ac. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Refreshing network info cache for port d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:28:25 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating resource usage from migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.344s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:25 user nova-compute[82009]: INFO nova.compute.manager [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Migrating
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updated VIF entry in instance network info cache for port d983c712-087e-4bf3-a5c9-98ae1eea11ac. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ed7b856b-e54f-4909-8ab3-06b166c97188 req-7d3f5467-d464-49f8-80c7-73c17a0ec7ad service nova] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Starting migrate_disk_and_power_off {{(pid=82009) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-unplugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG nova.compute.manager [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-unplugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:26 user nova-compute[82009]: WARNING nova.compute.manager [req-e39761fc-9440-49ac-b7e3-ddf40a058302 req-083d295e-9a95-41af-a26b-1add1617788f service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-unplugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state active and task_state resize_migrating.
Apr 11 18:28:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:27 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance destroyed successfully.
Apr 11 18:28:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1486538402',display_name='tempest-ServerActionsTestJSON-server-1486538402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1486538402',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-5rr47ocf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=d853cbf3-7869-416c-af88-0b01b498705a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd983c712-08, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:28:27 user nova-compute[82009]: INFO os_vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08')
Apr 11 18:28:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:28:27 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be428a1-7912-4121-b66f-97bceacad21c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:28:27 user nova-compute[82009]: No targets found.
Apr 11 18:28:27 user nova-compute[82009]: iSNS:
Apr 11 18:28:27 user nova-compute[82009]: No targets found.
Apr 11 18:28:27 user nova-compute[82009]: STATIC:
Apr 11 18:28:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:28:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:28:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:28:27 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:28:27 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:28:27 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:28:27 user nova-compute[82009]: FIRMWARE:
Apr 11 18:28:27 user nova-compute[82009]: No targets found.
Apr 11 18:28:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:28:27 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:28:27 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[25483680-5a2c-413d-9188-b08700a31fe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d588bc35-c3aa-410b-8e09-425aed7fed8e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:27 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:27 user nova-compute[82009]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6ce00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b'): ({'sde'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sde {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5cfae-5358-46c3-95d7-2d159ade8915]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a11a8-77f8-430a-ad90-005631ebd55d]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sde {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cbd4a7-49f5-429e-9232-d315026b2804]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022d665-f719-4728-8ec3-e3504559b31b]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26230346638333135', '/dev/disk/by-id/scsi-1SCST_BIO62fcd6e4-b04f83150fa7200d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_62fcd6e4') {{(pid=92248) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3099d930-8159-4491-8cfc-6bf6ff4671c5]: (4, None) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b906e-ff9c-40ab-a218-f9916264966f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb8e6d-ebd6-4757-89e5-14f92391b622]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]
Apr 11 18:28:27 user nova-compute[82009]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.
Apr 11 18:28:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1dd94c-170c-4fb4-a5bc-aecfbfa6279a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (348ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:28:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG nova.compute.manager [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:28 user nova-compute[82009]: WARNING nova.compute.manager [req-81599ebb-8b18-49f8-add1-591d6bb27de6 req-86332181-56e5-482b-9ec4-e0b517ec0182 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state active and task_state resize_migrating.
Apr 11 18:28:28 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Port d983c712-087e-4bf3-a5c9-98ae1eea11ac binding to destination host user is already ACTIVE {{(pid=82009) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:29 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:28:29 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG os_brick.utils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[84227125-aed5-4a7f-9afd-91b48cee13c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9c08c-4fda-4dd8-b70a-0746ede04e32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16dc41-fa6d-4576-9b51-425de35e3aaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fcf80b-953a-4ea6-b653-3b41e7ec18f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:28:30 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:28:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228b765-6b2f-451c-b4fe-933bcc7d7812]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:28:30 user nova-compute[82009]: DEBUG os_brick.utils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:28:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Starting finish_migration {{(pid=82009) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:28:34 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Creating image(s)
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Ensure instance console log exists: /opt/stack/data/nova/instances/d853cbf3-7869-416c-af88-0b01b498705a/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Start _get_guest_xml network_info=[{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd847b828-c777-4393-a8fa-a54afe788435', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd853cbf3-7869-416c-af88-0b01b498705a', 'attached_at': '2023-04-11T18:28:35.000000', 'detached_at': '', 'volume_id': 'eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'serial': 'eb51b2ca-fd24-41b8-bc39-fc11e130b55b'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:28:34 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:28:34 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'vcpu_model' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:28:34 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:28:34 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:28:34 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:28:34 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:28:34 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3717a3e4-eb65-4230-bbb1-18d4af5ced66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:28:34 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:34 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d7a84-3f2c-4dd7-8dd7-24a474354197]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b] added
Apr 11 18:28:35 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3aeb1a-7e2c-4da3-9d8c-0bb53da611f2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7415fdc4-6b84-4477-a83a-3e414733dc82]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DvasrCSQ {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DvasrCSQ" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[886249f9-4c5d-4f13-8880-e16f7605cf8f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DvasrCSQ'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ff20e-9fbf-4d8e-a37a-926cb882b578]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[da91d2d2-898f-4a13-b827-8db170517d3a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:35 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:35 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b100e4-11ab-41eb-8aa0-231c105659b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]
Apr 11 18:28:35 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.
Apr 11 18:28:35 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b667b-9497-4014-8103-4e9da15d5a81]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa3d41-2050-43a7-b931-bb0f352146ff]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:35 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:35 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:35 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:35 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0967f006-2abb-4fd7-9426-08a1c02350c3]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:28:35 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26230346638333135', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230346638333135', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1486538402',display_name='tempest-ServerActionsTestJSON-server-1486538402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1486538402',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-5rr47ocf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=d853cbf3-7869-416c-af88-0b01b498705a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:28:36 user nova-compute[82009]:   <uuid>d853cbf3-7869-416c-af88-0b01b498705a</uuid>
Apr 11 18:28:36 user nova-compute[82009]:   <name>instance-00000023</name>
Apr 11 18:28:36 user nova-compute[82009]:   <memory>196608</memory>
Apr 11 18:28:36 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:28:36 user nova-compute[82009]:   <metadata>
Apr 11 18:28:36 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:28:36 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:28:36 user nova-compute[82009]:       <nova:name>tempest-ServerActionsTestJSON-server-1486538402</nova:name>
Apr 11 18:28:36 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:28:34</nova:creationTime>
Apr 11 18:28:36 user nova-compute[82009]:       <nova:flavor name="m1.micro">
Apr 11 18:28:36 user nova-compute[82009]:         <nova:memory>192</nova:memory>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:28:36 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:28:36 user nova-compute[82009]:       <nova:owner>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:user uuid="5ea51d683a9e45529a4eafc2359be9c8">tempest-ServerActionsTestJSON-1277136387-project-member</nova:user>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:project uuid="e49c5486b65e4d3eaab7c35fe84ac9c9">tempest-ServerActionsTestJSON-1277136387</nova:project>
Apr 11 18:28:36 user nova-compute[82009]:       </nova:owner>
Apr 11 18:28:36 user nova-compute[82009]:       <nova:ports>
Apr 11 18:28:36 user nova-compute[82009]:         <nova:port uuid="d983c712-087e-4bf3-a5c9-98ae1eea11ac">
Apr 11 18:28:36 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 18:28:36 user nova-compute[82009]:         </nova:port>
Apr 11 18:28:36 user nova-compute[82009]:       </nova:ports>
Apr 11 18:28:36 user nova-compute[82009]:     </nova:instance>
Apr 11 18:28:36 user nova-compute[82009]:   </metadata>
Apr 11 18:28:36 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:28:36 user nova-compute[82009]:     <system>
Apr 11 18:28:36 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:28:36 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:28:36 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:28:36 user nova-compute[82009]:       <entry name="serial">d853cbf3-7869-416c-af88-0b01b498705a</entry>
Apr 11 18:28:36 user nova-compute[82009]:       <entry name="uuid">d853cbf3-7869-416c-af88-0b01b498705a</entry>
Apr 11 18:28:36 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:28:36 user nova-compute[82009]:     </system>
Apr 11 18:28:36 user nova-compute[82009]:   </sysinfo>
Apr 11 18:28:36 user nova-compute[82009]:   <os>
Apr 11 18:28:36 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:28:36 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:28:36 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:28:36 user nova-compute[82009]:   </os>
Apr 11 18:28:36 user nova-compute[82009]:   <features>
Apr 11 18:28:36 user nova-compute[82009]:     <acpi/>
Apr 11 18:28:36 user nova-compute[82009]:     <apic/>
Apr 11 18:28:36 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:28:36 user nova-compute[82009]:   </features>
Apr 11 18:28:36 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:28:36 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:28:36 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:28:36 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:28:36 user nova-compute[82009]:   </clock>
Apr 11 18:28:36 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:28:36 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:28:36 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:28:36 user nova-compute[82009]:   </cpu>
Apr 11 18:28:36 user nova-compute[82009]:   <devices>
Apr 11 18:28:36 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:28:36 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:28:36 user nova-compute[82009]:       <source dev="/dev/sdb"/>
Apr 11 18:28:36 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:28:36 user nova-compute[82009]:       <serial>eb51b2ca-fd24-41b8-bc39-fc11e130b55b</serial>
Apr 11 18:28:36 user nova-compute[82009]:     </disk>
Apr 11 18:28:36 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:28:36 user nova-compute[82009]:       <mac address="fa:16:3e:bb:b5:bc"/>
Apr 11 18:28:36 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:28:36 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:28:36 user nova-compute[82009]:       <target dev="tapd983c712-08"/>
Apr 11 18:28:36 user nova-compute[82009]:     </interface>
Apr 11 18:28:36 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:28:36 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/d853cbf3-7869-416c-af88-0b01b498705a/console.log" append="off"/>
Apr 11 18:28:36 user nova-compute[82009]:     </serial>
Apr 11 18:28:36 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:28:36 user nova-compute[82009]:     <video>
Apr 11 18:28:36 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:28:36 user nova-compute[82009]:     </video>
Apr 11 18:28:36 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:28:36 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:28:36 user nova-compute[82009]:     </rng>
Apr 11 18:28:36 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:28:36 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:28:36 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:28:36 user nova-compute[82009]:     </memballoon>
Apr 11 18:28:36 user nova-compute[82009]:   </devices>
Apr 11 18:28:36 user nova-compute[82009]: </domain>
Apr 11 18:28:36 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1486538402',display_name='tempest-ServerActionsTestJSON-server-1486538402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1486538402',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-5rr47ocf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=d853cbf3-7869-416c-af88-0b01b498705a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-817403215-network", "vif_mac": "fa:16:3e:bb:b5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG os_vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd983c712-08, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd983c712-08, col_values=(('external_ids', {'iface-id': 'd983c712-087e-4bf3-a5c9-98ae1eea11ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b5:bc', 'vm-uuid': 'd853cbf3-7869-416c-af88-0b01b498705a'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:36 user nova-compute[82009]: INFO os_vif [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08')
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:28:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] No VIF found with MAC fa:16:3e:bb:b5:bc, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "65d0bb76-375f-432e-acc9-97a5becbca95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:37 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:28:37 user nova-compute[82009]: INFO nova.compute.claims [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Claim successful on node user
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:38 user nova-compute[82009]: WARNING nova.compute.manager [req-1796f57c-8dbe-455f-ae6b-26fd0712172b req-afc84ed6-05ca-4519-8e49-e51aebd70ba8 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state active and task_state resize_finish.
Apr 11 18:28:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:28:38 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:28:38 user nova-compute[82009]: INFO nova.virt.block_device [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Booting with volume 6709e067-9e56-479d-9981-a93cbfbf9296 at /dev/vda
Apr 11 18:28:38 user nova-compute[82009]: DEBUG os_brick.utils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.policy [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d87ed1-e998-4353-952c-7a2789c08c56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[271446da-3c1d-4c22-a97b-0614eecf7d1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba0eb0d-e38a-4380-a502-89fb766d9456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b25cdf-7b47-4327-819d-bad0a0140219]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:28:38 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:28:38 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a90647-4563-44e2-a6e5-8e0ee41c1e3a]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG os_brick.utils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:28:38 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updating existing volume attachment record: 8c9ee952-f748-4a44-a213-3027a1e174f8 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:28:39 user nova-compute[82009]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Successfully created port: 59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for d853cbf3-7869-416c-af88-0b01b498705a due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237720.0992463, d853cbf3-7869-416c-af88-0b01b498705a => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:28:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] VM Resumed (Lifecycle Event)
Apr 11 18:28:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance running successfully.
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Failed to set time: agent not configured {{(pid=82009) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9ee8c49f-4da9-49e1-9783-6cc73e546a99 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] finish_migration finished successfully. {{(pid=82009) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:40 user nova-compute[82009]: WARNING nova.compute.manager [req-072a7cbc-63aa-4b74-b85f-5693fee66ffe req-b31b8215-854e-45eb-90b7-0d2be356b43f service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state active and task_state resize_finish.
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:28:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237720.1061356, d853cbf3-7869-416c-af88-0b01b498705a => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:28:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] VM Started (Lifecycle Event)
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Successfully updated port: 59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquired lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:28:40 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.network.neutron [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updating instance_info_cache with network_info: [{"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Releasing lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Instance network_info: |[{"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:28:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-changed-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Refreshing instance network info cache due to event network-changed-59743a6c-f7b8-42a5-95a1-97101a45ce4c. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Acquiring lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Acquired lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Refreshing network info cache for port 59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updated VIF entry in instance network info cache for port 59743a6c-f7b8-42a5-95a1-97101a45ce4c. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updating instance_info_cache with network_info: [{"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:28:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-82d2d525-e4c2-49bf-a726-e31f6e481840 req-059283ec-0c4b-428b-adb5-a463e6e41d75 service nova] Releasing lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:28:43 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Creating image(s)
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Ensure instance console log exists: /opt/stack/data/nova/instances/65d0bb76-375f-432e-acc9-97a5becbca95/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Start _get_guest_xml network_info=[{"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8c9ee952-f748-4a44-a213-3027a1e174f8', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65d0bb76-375f-432e-acc9-97a5becbca95', 'attached_at': '', 'detached_at': '', 'volume_id': '6709e067-9e56-479d-9981-a93cbfbf9296', 'serial': '6709e067-9e56-479d-9981-a93cbfbf9296'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:28:43 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:28:43 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:28:43 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:28:43 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:28:43 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bf0bce-ce2a-4649-b788-0cbc6429c00a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:28:43 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149236a-f3a4-4e47-9b53-0722846f450a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296] added
Apr 11 18:28:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8665cfd4-5d18-4741-b547-59376bba67aa]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c83350-cf1e-49b8-b520-579d6718f585]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URKwAkNr {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URKwAkNr" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b133ca-3681-43e5-abab-754ac2d7aa4c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URKwAkNr'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd36960-0870-45fb-b611-7d9c9121dadf]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[82203a23-3eb4-4b97-a2d9-cec67fb681fd]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:43 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:43 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28154541-6750-4129-9478-b076cbb4c4ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]
Apr 11 18:28:43 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.
Apr 11 18:28:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf0dd5-7eea-47cf-9128-793031713955]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba55749-9899-4a33-af90-72378252d42a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:43 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:43 user nova-compute[82009]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:28:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:28:43 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:28:43 user nova-compute[82009]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:28:43 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6837b143-f403-4a61-8068-0c79a1bdba0c]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:28:43 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23231316231313166', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231316231313166', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-828402740',display_name='tempest-TestVolumeBootPattern-server-828402740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-828402740',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-nwd3poyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:28:38Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=65d0bb76-375f-432e-acc9-97a5becbca95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.objects.instance [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'pci_devices' on Instance uuid 65d0bb76-375f-432e-acc9-97a5becbca95 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:28:44 user nova-compute[82009]:   <uuid>65d0bb76-375f-432e-acc9-97a5becbca95</uuid>
Apr 11 18:28:44 user nova-compute[82009]:   <name>instance-00000024</name>
Apr 11 18:28:44 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:28:44 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:28:44 user nova-compute[82009]:   <metadata>
Apr 11 18:28:44 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:28:44 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:28:44 user nova-compute[82009]:       <nova:name>tempest-TestVolumeBootPattern-server-828402740</nova:name>
Apr 11 18:28:44 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:28:43</nova:creationTime>
Apr 11 18:28:44 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:28:44 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:28:44 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:28:44 user nova-compute[82009]:       <nova:owner>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:user uuid="4c8825bcd5894c999412499de320dc00">tempest-TestVolumeBootPattern-1768143130-project-member</nova:user>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:project uuid="e4f6857b777f4207b93d8c28aa39054b">tempest-TestVolumeBootPattern-1768143130</nova:project>
Apr 11 18:28:44 user nova-compute[82009]:       </nova:owner>
Apr 11 18:28:44 user nova-compute[82009]:       <nova:ports>
Apr 11 18:28:44 user nova-compute[82009]:         <nova:port uuid="59743a6c-f7b8-42a5-95a1-97101a45ce4c">
Apr 11 18:28:44 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 18:28:44 user nova-compute[82009]:         </nova:port>
Apr 11 18:28:44 user nova-compute[82009]:       </nova:ports>
Apr 11 18:28:44 user nova-compute[82009]:     </nova:instance>
Apr 11 18:28:44 user nova-compute[82009]:   </metadata>
Apr 11 18:28:44 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:28:44 user nova-compute[82009]:     <system>
Apr 11 18:28:44 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:28:44 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:28:44 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:28:44 user nova-compute[82009]:       <entry name="serial">65d0bb76-375f-432e-acc9-97a5becbca95</entry>
Apr 11 18:28:44 user nova-compute[82009]:       <entry name="uuid">65d0bb76-375f-432e-acc9-97a5becbca95</entry>
Apr 11 18:28:44 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:28:44 user nova-compute[82009]:     </system>
Apr 11 18:28:44 user nova-compute[82009]:   </sysinfo>
Apr 11 18:28:44 user nova-compute[82009]:   <os>
Apr 11 18:28:44 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:28:44 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:28:44 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:28:44 user nova-compute[82009]:   </os>
Apr 11 18:28:44 user nova-compute[82009]:   <features>
Apr 11 18:28:44 user nova-compute[82009]:     <acpi/>
Apr 11 18:28:44 user nova-compute[82009]:     <apic/>
Apr 11 18:28:44 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:28:44 user nova-compute[82009]:   </features>
Apr 11 18:28:44 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:28:44 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:28:44 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:28:44 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:28:44 user nova-compute[82009]:   </clock>
Apr 11 18:28:44 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:28:44 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:28:44 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:28:44 user nova-compute[82009]:   </cpu>
Apr 11 18:28:44 user nova-compute[82009]:   <devices>
Apr 11 18:28:44 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:28:44 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:28:44 user nova-compute[82009]:       <source dev="/dev/sdd"/>
Apr 11 18:28:44 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:28:44 user nova-compute[82009]:       <serial>6709e067-9e56-479d-9981-a93cbfbf9296</serial>
Apr 11 18:28:44 user nova-compute[82009]:     </disk>
Apr 11 18:28:44 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:28:44 user nova-compute[82009]:       <mac address="fa:16:3e:a3:05:ca"/>
Apr 11 18:28:44 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:28:44 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:28:44 user nova-compute[82009]:       <target dev="tap59743a6c-f7"/>
Apr 11 18:28:44 user nova-compute[82009]:     </interface>
Apr 11 18:28:44 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:28:44 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/65d0bb76-375f-432e-acc9-97a5becbca95/console.log" append="off"/>
Apr 11 18:28:44 user nova-compute[82009]:     </serial>
Apr 11 18:28:44 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:28:44 user nova-compute[82009]:     <video>
Apr 11 18:28:44 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:28:44 user nova-compute[82009]:     </video>
Apr 11 18:28:44 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:28:44 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:28:44 user nova-compute[82009]:     </rng>
Apr 11 18:28:44 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:28:44 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:28:44 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:28:44 user nova-compute[82009]:     </memballoon>
Apr 11 18:28:44 user nova-compute[82009]:   </devices>
Apr 11 18:28:44 user nova-compute[82009]: </domain>
Apr 11 18:28:44 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-828402740',display_name='tempest-TestVolumeBootPattern-server-828402740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-828402740',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-nwd3poyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:28:38Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=65d0bb76-375f-432e-acc9-97a5becbca95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG os_vif [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59743a6c-f7, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59743a6c-f7, col_values=(('external_ids', {'iface-id': '59743a6c-f7b8-42a5-95a1-97101a45ce4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:05:ca', 'vm-uuid': '65d0bb76-375f-432e-acc9-97a5becbca95'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:28:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:44 user nova-compute[82009]: INFO os_vif [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7')
Apr 11 18:28:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:28:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No VIF found with MAC fa:16:3e:a3:05:ca, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] No waiting events found dispatching network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:46 user nova-compute[82009]: WARNING nova.compute.manager [req-8536e6a2-bd2b-43ca-a3e1-f2146e0bdc0f req-e4c04a54-d9ad-4f2a-a21a-54d02b62ef3b service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received unexpected event network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance with vm_state building and task_state spawning.
Apr 11 18:28:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237728.7490256, 65d0bb76-375f-432e-acc9-97a5becbca95 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] VM Resumed (Lifecycle Event)
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] No waiting events found dispatching network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:28:48 user nova-compute[82009]: WARNING nova.compute.manager [req-032fe8df-eb8c-41c6-af11-11c9cbdbef65 req-e2bad37a-360b-4214-84a4-a45633419d9e service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received unexpected event network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance with vm_state building and task_state spawning.
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Instance spawned successfully.
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237728.7553515, 65d0bb76-375f-432e-acc9-97a5becbca95 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] VM Started (Lifecycle Event)
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Took 5.44 seconds to spawn the instance on the hypervisor.
Apr 11 18:28:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:28:48 user nova-compute[82009]: INFO nova.compute.manager [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Took 11.19 seconds to build instance.
Apr 11 18:28:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-582b9d79-b1f6-4e17-9c5f-3fa055058e70 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "65d0bb76-375f-432e-acc9-97a5becbca95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.309s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:28:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:28:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:29:05 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:07 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:29:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:29:09 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:29:09 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8259MB free_disk=26.314071655273438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Applying migration context for instance d853cbf3-7869-416c-af88-0b01b498705a as it has an incoming, in-progress migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff. Migration status is finished {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 18:29:09 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating resource usage from migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d853cbf3-7869-416c-af88-0b01b498705a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 65d0bb76-375f-432e-acc9-97a5becbca95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:29:10 user nova-compute[82009]: INFO nova.compute.claims [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Claim successful on node user
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:29:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:29:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.policy [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:29:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Creating image(s)
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk 1073741824" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.160s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Cannot resize image /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.objects.instance [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'migration_context' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Ensure instance console log exists: /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Successfully created port: 4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Successfully updated port: 4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquired lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-changed-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Refreshing instance network info cache due to event network-changed-4c35126a-2ca0-4982-864d-7006fbc34a4d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Acquiring lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:29:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updating instance_info_cache with network_info: [{"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Releasing lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Instance network_info: |[{"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Acquired lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Refreshing network info cache for port 4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Start _get_guest_xml network_info=[{"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:29:13 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:29:13 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1018724989',display_name='tempest-AttachVolumeNegativeTest-server-1018724989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1018724989',id=37,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs3E53rMZKipajWGRqQNLsyHSKcE1Cs3luZCWsL04LhnfSC2/CNpZVWRwyQLpg30e3tVrpCk5563xjYj4TS9PlR6KzO1JX6F3Xn3TwcxmVfPqms9QO0aJW9BV6zucfu+g==',key_name='tempest-keypair-1464858302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-o1dmznv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=fbf10cce-a01c-4e3f-8212-a2a0d42713df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.objects.instance [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'pci_devices' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:29:13 user nova-compute[82009]:   <uuid>fbf10cce-a01c-4e3f-8212-a2a0d42713df</uuid>
Apr 11 18:29:13 user nova-compute[82009]:   <name>instance-00000025</name>
Apr 11 18:29:13 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:29:13 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:29:13 user nova-compute[82009]:   <metadata>
Apr 11 18:29:13 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:29:13 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:29:13 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1018724989</nova:name>
Apr 11 18:29:13 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:29:13</nova:creationTime>
Apr 11 18:29:13 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:29:13 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:29:13 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:29:13 user nova-compute[82009]:       <nova:owner>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:user uuid="b91adf882c384c8c9e27a24a8c55b0a1">tempest-AttachVolumeNegativeTest-1806714760-project-member</nova:user>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:project uuid="a92ba4ae3f244cfc9f3f0732ab9cc649">tempest-AttachVolumeNegativeTest-1806714760</nova:project>
Apr 11 18:29:13 user nova-compute[82009]:       </nova:owner>
Apr 11 18:29:13 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:29:13 user nova-compute[82009]:       <nova:ports>
Apr 11 18:29:13 user nova-compute[82009]:         <nova:port uuid="4c35126a-2ca0-4982-864d-7006fbc34a4d">
Apr 11 18:29:13 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 18:29:13 user nova-compute[82009]:         </nova:port>
Apr 11 18:29:13 user nova-compute[82009]:       </nova:ports>
Apr 11 18:29:13 user nova-compute[82009]:     </nova:instance>
Apr 11 18:29:13 user nova-compute[82009]:   </metadata>
Apr 11 18:29:13 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:29:13 user nova-compute[82009]:     <system>
Apr 11 18:29:13 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:29:13 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:29:13 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:29:13 user nova-compute[82009]:       <entry name="serial">fbf10cce-a01c-4e3f-8212-a2a0d42713df</entry>
Apr 11 18:29:13 user nova-compute[82009]:       <entry name="uuid">fbf10cce-a01c-4e3f-8212-a2a0d42713df</entry>
Apr 11 18:29:13 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:29:13 user nova-compute[82009]:     </system>
Apr 11 18:29:13 user nova-compute[82009]:   </sysinfo>
Apr 11 18:29:13 user nova-compute[82009]:   <os>
Apr 11 18:29:13 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:29:13 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:29:13 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:29:13 user nova-compute[82009]:   </os>
Apr 11 18:29:13 user nova-compute[82009]:   <features>
Apr 11 18:29:13 user nova-compute[82009]:     <acpi/>
Apr 11 18:29:13 user nova-compute[82009]:     <apic/>
Apr 11 18:29:13 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:29:13 user nova-compute[82009]:   </features>
Apr 11 18:29:13 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:29:13 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:29:13 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:29:13 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:29:13 user nova-compute[82009]:   </clock>
Apr 11 18:29:13 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:29:13 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:29:13 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:29:13 user nova-compute[82009]:   </cpu>
Apr 11 18:29:13 user nova-compute[82009]:   <devices>
Apr 11 18:29:13 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:29:13 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:29:13 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk"/>
Apr 11 18:29:13 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:29:13 user nova-compute[82009]:     </disk>
Apr 11 18:29:13 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:29:13 user nova-compute[82009]:       <mac address="fa:16:3e:de:d7:d8"/>
Apr 11 18:29:13 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:29:13 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:29:13 user nova-compute[82009]:       <target dev="tap4c35126a-2c"/>
Apr 11 18:29:13 user nova-compute[82009]:     </interface>
Apr 11 18:29:13 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:29:13 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/console.log" append="off"/>
Apr 11 18:29:13 user nova-compute[82009]:     </serial>
Apr 11 18:29:13 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:29:13 user nova-compute[82009]:     <video>
Apr 11 18:29:13 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:29:13 user nova-compute[82009]:     </video>
Apr 11 18:29:13 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:29:13 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:29:13 user nova-compute[82009]:     </rng>
Apr 11 18:29:13 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:29:13 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:29:13 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:29:13 user nova-compute[82009]:     </memballoon>
Apr 11 18:29:13 user nova-compute[82009]:   </devices>
Apr 11 18:29:13 user nova-compute[82009]: </domain>
Apr 11 18:29:13 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1018724989',display_name='tempest-AttachVolumeNegativeTest-server-1018724989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1018724989',id=37,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs3E53rMZKipajWGRqQNLsyHSKcE1Cs3luZCWsL04LhnfSC2/CNpZVWRwyQLpg30e3tVrpCk5563xjYj4TS9PlR6KzO1JX6F3Xn3TwcxmVfPqms9QO0aJW9BV6zucfu+g==',key_name='tempest-keypair-1464858302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-o1dmznv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=fbf10cce-a01c-4e3f-8212-a2a0d42713df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG os_vif [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c35126a-2c, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c35126a-2c, col_values=(('external_ids', {'iface-id': '4c35126a-2ca0-4982-864d-7006fbc34a4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d7:d8', 'vm-uuid': 'fbf10cce-a01c-4e3f-8212-a2a0d42713df'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:13 user nova-compute[82009]: INFO os_vif [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c')
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:de:d7:d8, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updated VIF entry in instance network info cache for port 4c35126a-2ca0-4982-864d-7006fbc34a4d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updating instance_info_cache with network_info: [{"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:29:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b3cf09b-8b4b-4935-8746-d94268849e84 req-4e763f0f-7040-4199-b515-19ad234216cb service nova] Releasing lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:14 user nova-compute[82009]: DEBUG nova.compute.manager [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] No waiting events found dispatching network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:29:14 user nova-compute[82009]: WARNING nova.compute.manager [req-e57c64e1-bd81-4a95-87be-0b59651fe3ea req-27ef3831-bfda-47d0-bf07-b251c8e6f334 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received unexpected event network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d for instance with vm_state building and task_state spawning.
Apr 11 18:29:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237756.8665724, fbf10cce-a01c-4e3f-8212-a2a0d42713df => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:29:16 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] VM Resumed (Lifecycle Event)
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:29:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Instance spawned successfully.
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:16 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237756.871625, fbf10cce-a01c-4e3f-8212-a2a0d42713df => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:29:16 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] VM Started (Lifecycle Event)
Apr 11 18:29:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "91053286-2092-4540-a527-564c0cf78bd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] No waiting events found dispatching network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:29:16 user nova-compute[82009]: WARNING nova.compute.manager [req-961fe7b7-4ff8-409e-8a9a-bf99f2fc7b89 req-25b357d8-02d6-4841-b3c4-72af89bbe224 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received unexpected event network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d for instance with vm_state building and task_state spawning.
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:29:16 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:29:16 user nova-compute[82009]: INFO nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 11 18:29:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:29:17 user nova-compute[82009]: INFO nova.compute.claims [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Claim successful on node user
Apr 11 18:29:17 user nova-compute[82009]: INFO nova.compute.manager [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Took 6.60 seconds to build instance.
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-be676b42-eed9-4f35-8d0f-ff00fe9e2134 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.737s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:29:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.policy [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:29:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Creating image(s)
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "/opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.155s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.158s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk 1073741824" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.159s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Successfully created port: b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Cannot resize image /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG nova.objects.instance [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'migration_context' on Instance uuid 91053286-2092-4540-a527-564c0cf78bd3 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Ensure instance console log exists: /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Successfully updated port: b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-changed-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Refreshing instance network info cache due to event network-changed-b5910cd2-0ef5-4d68-8dcf-5031c519642a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Acquiring lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Updating instance_info_cache with network_info: [{"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Instance network_info: |[{"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Acquired lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.neutron [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Refreshing network info cache for port b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Start _get_guest_xml network_info=[{"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:29:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:29:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-966866756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-966866756',id=38,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-k0n2bzh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:29:18Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=91053286-2092-4540-a527-564c0cf78bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'pci_devices' on Instance uuid 91053286-2092-4540-a527-564c0cf78bd3 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:29:19 user nova-compute[82009]:   <uuid>91053286-2092-4540-a527-564c0cf78bd3</uuid>
Apr 11 18:29:19 user nova-compute[82009]:   <name>instance-00000026</name>
Apr 11 18:29:19 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:29:19 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:29:19 user nova-compute[82009]:   <metadata>
Apr 11 18:29:19 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:29:19 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:29:19 user nova-compute[82009]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-966866756</nova:name>
Apr 11 18:29:19 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:29:19</nova:creationTime>
Apr 11 18:29:19 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:29:19 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:29:19 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:29:19 user nova-compute[82009]:       <nova:owner>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:user uuid="fde784625fda4447afc0b8e9bd0983a3">tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member</nova:user>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:project uuid="62a254c432f54e1b8735e40af7063506">tempest-ServerBootFromVolumeStableRescueTest-1689319261</nova:project>
Apr 11 18:29:19 user nova-compute[82009]:       </nova:owner>
Apr 11 18:29:19 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:29:19 user nova-compute[82009]:       <nova:ports>
Apr 11 18:29:19 user nova-compute[82009]:         <nova:port uuid="b5910cd2-0ef5-4d68-8dcf-5031c519642a">
Apr 11 18:29:19 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 18:29:19 user nova-compute[82009]:         </nova:port>
Apr 11 18:29:19 user nova-compute[82009]:       </nova:ports>
Apr 11 18:29:19 user nova-compute[82009]:     </nova:instance>
Apr 11 18:29:19 user nova-compute[82009]:   </metadata>
Apr 11 18:29:19 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:29:19 user nova-compute[82009]:     <system>
Apr 11 18:29:19 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:29:19 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:29:19 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:29:19 user nova-compute[82009]:       <entry name="serial">91053286-2092-4540-a527-564c0cf78bd3</entry>
Apr 11 18:29:19 user nova-compute[82009]:       <entry name="uuid">91053286-2092-4540-a527-564c0cf78bd3</entry>
Apr 11 18:29:19 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:29:19 user nova-compute[82009]:     </system>
Apr 11 18:29:19 user nova-compute[82009]:   </sysinfo>
Apr 11 18:29:19 user nova-compute[82009]:   <os>
Apr 11 18:29:19 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:29:19 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:29:19 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:29:19 user nova-compute[82009]:   </os>
Apr 11 18:29:19 user nova-compute[82009]:   <features>
Apr 11 18:29:19 user nova-compute[82009]:     <acpi/>
Apr 11 18:29:19 user nova-compute[82009]:     <apic/>
Apr 11 18:29:19 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:29:19 user nova-compute[82009]:   </features>
Apr 11 18:29:19 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:29:19 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:29:19 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:29:19 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:29:19 user nova-compute[82009]:   </clock>
Apr 11 18:29:19 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:29:19 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:29:19 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:29:19 user nova-compute[82009]:   </cpu>
Apr 11 18:29:19 user nova-compute[82009]:   <devices>
Apr 11 18:29:19 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:29:19 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:29:19 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk"/>
Apr 11 18:29:19 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:29:19 user nova-compute[82009]:     </disk>
Apr 11 18:29:19 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:29:19 user nova-compute[82009]:       <mac address="fa:16:3e:ed:32:ea"/>
Apr 11 18:29:19 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:29:19 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:29:19 user nova-compute[82009]:       <target dev="tapb5910cd2-0e"/>
Apr 11 18:29:19 user nova-compute[82009]:     </interface>
Apr 11 18:29:19 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:29:19 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/console.log" append="off"/>
Apr 11 18:29:19 user nova-compute[82009]:     </serial>
Apr 11 18:29:19 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:29:19 user nova-compute[82009]:     <video>
Apr 11 18:29:19 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:29:19 user nova-compute[82009]:     </video>
Apr 11 18:29:19 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:29:19 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:29:19 user nova-compute[82009]:     </rng>
Apr 11 18:29:19 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:29:19 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:29:19 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:29:19 user nova-compute[82009]:     </memballoon>
Apr 11 18:29:19 user nova-compute[82009]:   </devices>
Apr 11 18:29:19 user nova-compute[82009]: </domain>
Apr 11 18:29:19 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-966866756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-966866756',id=38,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-k0n2bzh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:29:18Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=91053286-2092-4540-a527-564c0cf78bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG os_vif [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5910cd2-0e, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5910cd2-0e, col_values=(('external_ids', {'iface-id': 'b5910cd2-0ef5-4d68-8dcf-5031c519642a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:32:ea', 'vm-uuid': '91053286-2092-4540-a527-564c0cf78bd3'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:19 user nova-compute[82009]: INFO os_vif [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e')
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:29:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No VIF found with MAC fa:16:3e:ed:32:ea, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:29:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Updated VIF entry in instance network info cache for port b5910cd2-0ef5-4d68-8dcf-5031c519642a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:29:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Updating instance_info_cache with network_info: [{"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:29:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b3ef7709-7dfc-4bee-a292-4bfbff58ff27 req-508857b5-b599-4133-b689-03e86781a963 service nova] Releasing lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] No waiting events found dispatching network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:29:21 user nova-compute[82009]: WARNING nova.compute.manager [req-b5c27999-7c1c-47ce-9a7f-f80800dcf8fb req-9cf8be91-517d-44c2-9800-a0e68ef335fb service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received unexpected event network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance with vm_state building and task_state spawning.
Apr 11 18:29:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] No waiting events found dispatching network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:29:23 user nova-compute[82009]: WARNING nova.compute.manager [req-52f96350-da7f-4f79-b993-513b8cfc757e req-5713ed10-d2d5-4eee-bb80-ad03836844e7 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received unexpected event network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance with vm_state building and task_state spawning.
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237763.5973587, 91053286-2092-4540-a527-564c0cf78bd3 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] VM Resumed (Lifecycle Event)
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Instance spawned successfully.
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237763.6075861, 91053286-2092-4540-a527-564c0cf78bd3 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] VM Started (Lifecycle Event)
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Took 5.96 seconds to spawn the instance on the hypervisor.
Apr 11 18:29:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:29:23 user nova-compute[82009]: INFO nova.compute.manager [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Took 6.87 seconds to build instance.
Apr 11 18:29:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-741e89fe-f46b-473a-8f59-ad607602816f tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "91053286-2092-4540-a527-564c0cf78bd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.974s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:29:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:29:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:29:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:29:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:29:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:29:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:29:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:00 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:30:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:30:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:30:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:30:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:30:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:30:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:30:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:08 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:30:10 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:30:10 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=26.271007537841797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Applying migration context for instance d853cbf3-7869-416c-af88-0b01b498705a as it has an incoming, in-progress migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff. Migration status is finished {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 18:30:10 user nova-compute[82009]: INFO nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating resource usage from migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d853cbf3-7869-416c-af88-0b01b498705a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 65d0bb76-375f-432e-acc9-97a5becbca95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:30:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:30:11 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:30:11 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:30:11 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:30:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Going to confirm migration 2 {{(pid=82009) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:30:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'info_cache' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:30:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:30:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:30:15 user nova-compute[82009]: DEBUG nova.objects.instance [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'migration_context' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:30:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:16 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:30:16 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:30:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.280s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:16 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Deleted allocation for migration 2c4c53ad-0a9f-4544-87aa-e79d5ed6ffff
Apr 11 18:30:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-39819ba0-4828-4c14-bdb7-98d055657594 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.761s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:16 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:30:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:30:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:30:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:30:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:30:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:30:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:30:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-changed-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Refreshing instance network info cache due to event network-changed-59743a6c-f7b8-42a5-95a1-97101a45ce4c. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Acquiring lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Acquired lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG nova.network.neutron [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Refreshing network info cache for port 59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "65d0bb76-375f-432e-acc9-97a5becbca95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:29 user nova-compute[82009]: INFO nova.compute.manager [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Terminating instance
Apr 11 18:30:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updated VIF entry in instance network info cache for port 59743a6c-f7b8-42a5-95a1-97101a45ce4c. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updating instance_info_cache with network_info: [{"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7dff32bc-da92-4b79-b5c9-b4b9fde679c5 req-a10b6a4c-0270-4c2a-b074-fe9916fb5140 service nova] Releasing lock "refresh_cache-65d0bb76-375f-432e-acc9-97a5becbca95" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-vif-unplugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] No waiting events found dispatching network-vif-unplugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-75741042-c436-493f-bb75-5e94f8a240fa req-0d8c844e-ab75-4a19-aa64-246fb558e9bd service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-vif-unplugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:30:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Instance destroyed successfully.
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'resources' on Instance uuid 65d0bb76-375f-432e-acc9-97a5becbca95 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-828402740',display_name='tempest-TestVolumeBootPattern-server-828402740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-828402740',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:28:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-nwd3poyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:28:49Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=65d0bb76-375f-432e-acc9-97a5becbca95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "address": "fa:16:3e:a3:05:ca", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59743a6c-f7", "ovs_interfaceid": "59743a6c-f7b8-42a5-95a1-97101a45ce4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_vif [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59743a6c-f7, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:30:30 user nova-compute[82009]: INFO os_vif [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:05:ca,bridge_name='br-int',has_traffic_filtering=True,id=59743a6c-f7b8-42a5-95a1-97101a45ce4c,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59743a6c-f7')
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:30:30 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c02ae27-5701-4839-9e5e-02dee721e6d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:30:30 user nova-compute[82009]: No targets found.
Apr 11 18:30:30 user nova-compute[82009]: iSNS:
Apr 11 18:30:30 user nova-compute[82009]: No targets found.
Apr 11 18:30:30 user nova-compute[82009]: STATIC:
Apr 11 18:30:30 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:30:30 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:30:30 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:30:30 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:30:30 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:30:30 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:30:30 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296
Apr 11 18:30:30 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:30:30 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:30:30 user nova-compute[82009]: FIRMWARE:
Apr 11 18:30:30 user nova-compute[82009]: No targets found.
Apr 11 18:30:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:30:30 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:30:30 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41315f-e6d2-4ca7-af04-8b544de683f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457ddee-2f0f-4f5d-b932-68b73e1a2b9b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:30:30 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:30:30 user nova-compute[82009]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:30:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:30:30 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:30:30 user nova-compute[82009]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:30:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c02a7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece3404a-a104-4cf7-afca-9da39e4bf310]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9241853-c041-4a29-bc17-10a0d40abe6f]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09344cc-6280-4da3-93fa-9a030d8b95e7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a899a1-8f7e-434b-831a-f63e91e02281]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fe1ce362', '/dev/disk/by-id/scsi-1SCST_BIOfe1ce362-211b111f4bb25d0f', '/dev/disk/by-id/scsi-23231316231313166') {{(pid=92248) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c69a37-3702-4df8-90db-21642a475ffd]: (4, None) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c50e0-dacd-46f0-ab4e-f8eaccb4839a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ecb366-3ca5-4261-8b7a-790eea592bdf]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]
Apr 11 18:30:30 user nova-compute[82009]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.
Apr 11 18:30:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c45fd-069a-483b-88d6-60709a872394]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== disconnect_volume: return (314ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:30:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Deleting instance files /opt/stack/data/nova/instances/65d0bb76-375f-432e-acc9-97a5becbca95_del
Apr 11 18:30:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Deletion of /opt/stack/data/nova/instances/65d0bb76-375f-432e-acc9-97a5becbca95_del complete
Apr 11 18:30:30 user nova-compute[82009]: INFO nova.compute.manager [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 18:30:30 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:30:30 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:30:31 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:30:31 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Took 0.82 seconds to deallocate network for instance.
Apr 11 18:30:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-31eb73c6-e879-4302-84ef-459f014f3b04 req-896e28f7-3b8e-4906-9ef0-e0c45e8593d7 service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-vif-deleted-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received event network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Acquiring lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] Lock "65d0bb76-375f-432e-acc9-97a5becbca95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] No waiting events found dispatching network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:30:32 user nova-compute[82009]: WARNING nova.compute.manager [req-530ab9fa-a5f0-4e7f-bd1b-46ce98fcc8f4 req-ac673cf2-6190-4467-9367-2e1f2a28953b service nova] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Received unexpected event network-vif-plugged-59743a6c-f7b8-42a5-95a1-97101a45ce4c for instance with vm_state active and task_state deleting.
Apr 11 18:30:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:32 user nova-compute[82009]: INFO nova.compute.manager [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Took 0.78 seconds to detach 1 volumes for instance.
Apr 11 18:30:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:30:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:32 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Deleted allocations for instance 65d0bb76-375f-432e-acc9-97a5becbca95
Apr 11 18:30:33 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-b10de47a-06bf-4ff1-b02f-24a4f9d36435 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "65d0bb76-375f-432e-acc9-97a5becbca95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.403s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:30:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:45 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237830.508531, 65d0bb76-375f-432e-acc9-97a5becbca95 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:30:45 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] VM Stopped (Lifecycle Event)
Apr 11 18:30:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ead5ab1d-ce4c-4554-b38a-59a90d2e26dd None None] [instance: 65d0bb76-375f-432e-acc9-97a5becbca95] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:30:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:30:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:30:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-changed-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Refreshing instance network info cache due to event network-changed-4c35126a-2ca0-4982-864d-7006fbc34a4d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Acquiring lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Acquired lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Refreshing network info cache for port 4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updated VIF entry in instance network info cache for port 4c35126a-2ca0-4982-864d-7006fbc34a4d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG nova.network.neutron [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updating instance_info_cache with network_info: [{"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-acad2815-e611-4690-9ccd-a41eb28548cd req-a6c11656-85ce-4c4f-9c20-85323a326c56 service nova] Releasing lock "refresh_cache-fbf10cce-a01c-4e3f-8212-a2a0d42713df" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:31:01 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:02 user nova-compute[82009]: INFO nova.compute.manager [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Attaching volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc to /dev/vdb
Apr 11 18:31:03 user nova-compute[82009]: DEBUG os_brick.utils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d45e7-bbca-4ac7-b466-e17f9c7b66ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1bb082-2bca-4df6-a838-0b53724b2d41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d355b7ae-7884-4b74-b724-0ed0666d8b11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a2563-4535-46b2-8bc5-e3809318c7c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:31:03 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:31:03 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a409b2b-d50a-4a02-b846-4743b6531b49]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG os_brick.utils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:31:03 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updating existing volume attachment record: 64413422-29b7-49a3-bf80-0098266b1c66 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:31:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJKckbuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:31:07 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:31:07 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:31:07 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a7789-d263-483e-b05e-90d46eb1c7ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:31:07 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[30766c8c-9e35-44f1-83b3-3fec3d6c79d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc] added
Apr 11 18:31:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a4b391-b6c5-4a44-842a-f881c03c04e2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbeebfa-226a-40b0-9284-b8e9b7d8ed1f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJKckbuy {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJKckbuy" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[757fa3a6-c647-48b9-aa8b-dcdbce93dc11]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJKckbuy'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a51452a-e2e4-4b24-a17b-614da36be976]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a615e-7ff1-49fc-ab5e-35256f80bd7b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:07 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:07 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b1421-0d68-4067-884a-a2ae660c52b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260]
Apr 11 18:31:07 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260] successful.
Apr 11 18:31:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b5943-4c93-4401-b7bf-83c9a24bf086]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff56204-fe4d-4c49-9ceb-03877bc3c01c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:07 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:07 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:31:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:07 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:07 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:31:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5baea-54d7-456c-bc46-75705348e493]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJKckbuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:07 user nova-compute[82009]: INFO nova.compute.manager [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] instance snapshotting
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:31:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Beginning live snapshot process
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:31:07 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json -f qcow2 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updating instance_info_cache with network_info: [{"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-b2175ccc-960d-4eca-8e41-3783cf28410b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26336306263343836', 'path': '/dev/sdd'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336306263343836', 'path': '/dev/sdd'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.objects.instance [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsx0i03_e/23483b45af3f43c781f70b8a7ff1e2f5.delta 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:31:08 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:31:08 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:31:08 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:31:08 user nova-compute[82009]:   <serial>1a2b3d37-c5ab-4df4-9135-e366c9c642dc</serial>
Apr 11 18:31:08 user nova-compute[82009]: </disk>
Apr 11 18:31:08 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsx0i03_e/23483b45af3f43c781f70b8a7ff1e2f5.delta 1073741824" returned: 0 in 0.062s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:08 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 18:31:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:31:08 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:de:d7:d8, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-fa74eb52-6fe3-4998-be14-9ee4a14cbf0b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.121s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:09 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82009) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 18:31:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsx0i03_e/23483b45af3f43c781f70b8a7ff1e2f5.delta /opt/stack/data/nova/instances/snapshots/tmpsx0i03_e/23483b45af3f43c781f70b8a7ff1e2f5 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsx0i03_e/23483b45af3f43c781f70b8a7ff1e2f5.delta /opt/stack/data/nova/instances/snapshots/tmpsx0i03_e/23483b45af3f43c781f70b8a7ff1e2f5" returned: 0 in 0.553s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Snapshot extracted, beginning image upload
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:31:11 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:31:11 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:31:11 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8316MB free_disk=26.24383544921875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d853cbf3-7869-416c-af88-0b01b498705a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:12 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:31:12 user nova-compute[82009]: INFO nova.compute.claims [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Claim successful on node user
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:31:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.policy [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:31:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Snapshot image upload complete
Apr 11 18:31:13 user nova-compute[82009]: INFO nova.compute.manager [None req-173730b8-6b98-4d1c-8285-c5e5c28d43f2 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Took 5.50 seconds to snapshot the instance on the hypervisor.
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:31:13 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Creating image(s)
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk 1073741824" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:31:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Cannot resize image /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG nova.objects.instance [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'migration_context' on Instance uuid 8f7d2851-f711-4dc2-8166-133ea16c6a1b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Ensure instance console log exists: /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Successfully created port: 31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Successfully updated port: 31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquired lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-changed-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Refreshing instance network info cache due to event network-changed-31692cb0-d0c2-44fc-aeb3-489ddb201839. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Acquiring lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updating instance_info_cache with network_info: [{"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Releasing lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Instance network_info: |[{"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Acquired lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Refreshing network info cache for port 31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Start _get_guest_xml network_info=[{"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:31:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:31:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1458079097',display_name='tempest-AttachVolumeNegativeTest-server-1458079097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1458079097',id=39,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBneTmEZ0pN2UQnlNCBoG+jleLJbnM30xGDCQgQfFmgvBn8qq7xxOcd4Rerr6G7VYjxhDiFUwZai0A5JVSxZi4f41Ai9YF85rTqqnr5mQV8CI8ukRDiSMQwiZ6Clpof+DQ==',key_name='tempest-keypair-112673211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-b5a463ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=8f7d2851-f711-4dc2-8166-133ea16c6a1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.objects.instance [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f7d2851-f711-4dc2-8166-133ea16c6a1b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:31:16 user nova-compute[82009]:   <uuid>8f7d2851-f711-4dc2-8166-133ea16c6a1b</uuid>
Apr 11 18:31:16 user nova-compute[82009]:   <name>instance-00000027</name>
Apr 11 18:31:16 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:31:16 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:31:16 user nova-compute[82009]:   <metadata>
Apr 11 18:31:16 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:31:16 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:31:16 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1458079097</nova:name>
Apr 11 18:31:16 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:31:16</nova:creationTime>
Apr 11 18:31:16 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:31:16 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:31:16 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:31:16 user nova-compute[82009]:       <nova:owner>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:user uuid="b91adf882c384c8c9e27a24a8c55b0a1">tempest-AttachVolumeNegativeTest-1806714760-project-member</nova:user>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:project uuid="a92ba4ae3f244cfc9f3f0732ab9cc649">tempest-AttachVolumeNegativeTest-1806714760</nova:project>
Apr 11 18:31:16 user nova-compute[82009]:       </nova:owner>
Apr 11 18:31:16 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:31:16 user nova-compute[82009]:       <nova:ports>
Apr 11 18:31:16 user nova-compute[82009]:         <nova:port uuid="31692cb0-d0c2-44fc-aeb3-489ddb201839">
Apr 11 18:31:16 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:31:16 user nova-compute[82009]:         </nova:port>
Apr 11 18:31:16 user nova-compute[82009]:       </nova:ports>
Apr 11 18:31:16 user nova-compute[82009]:     </nova:instance>
Apr 11 18:31:16 user nova-compute[82009]:   </metadata>
Apr 11 18:31:16 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:31:16 user nova-compute[82009]:     <system>
Apr 11 18:31:16 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:31:16 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:31:16 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:31:16 user nova-compute[82009]:       <entry name="serial">8f7d2851-f711-4dc2-8166-133ea16c6a1b</entry>
Apr 11 18:31:16 user nova-compute[82009]:       <entry name="uuid">8f7d2851-f711-4dc2-8166-133ea16c6a1b</entry>
Apr 11 18:31:16 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:31:16 user nova-compute[82009]:     </system>
Apr 11 18:31:16 user nova-compute[82009]:   </sysinfo>
Apr 11 18:31:16 user nova-compute[82009]:   <os>
Apr 11 18:31:16 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:31:16 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:31:16 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:31:16 user nova-compute[82009]:   </os>
Apr 11 18:31:16 user nova-compute[82009]:   <features>
Apr 11 18:31:16 user nova-compute[82009]:     <acpi/>
Apr 11 18:31:16 user nova-compute[82009]:     <apic/>
Apr 11 18:31:16 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:31:16 user nova-compute[82009]:   </features>
Apr 11 18:31:16 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:31:16 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:31:16 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:31:16 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:31:16 user nova-compute[82009]:   </clock>
Apr 11 18:31:16 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:31:16 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:31:16 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:31:16 user nova-compute[82009]:   </cpu>
Apr 11 18:31:16 user nova-compute[82009]:   <devices>
Apr 11 18:31:16 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:31:16 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:31:16 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk"/>
Apr 11 18:31:16 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:31:16 user nova-compute[82009]:     </disk>
Apr 11 18:31:16 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:31:16 user nova-compute[82009]:       <mac address="fa:16:3e:6d:34:90"/>
Apr 11 18:31:16 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:31:16 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:31:16 user nova-compute[82009]:       <target dev="tap31692cb0-d0"/>
Apr 11 18:31:16 user nova-compute[82009]:     </interface>
Apr 11 18:31:16 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:31:16 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/console.log" append="off"/>
Apr 11 18:31:16 user nova-compute[82009]:     </serial>
Apr 11 18:31:16 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:31:16 user nova-compute[82009]:     <video>
Apr 11 18:31:16 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:31:16 user nova-compute[82009]:     </video>
Apr 11 18:31:16 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:31:16 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:31:16 user nova-compute[82009]:     </rng>
Apr 11 18:31:16 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:31:16 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:31:16 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:31:16 user nova-compute[82009]:     </memballoon>
Apr 11 18:31:16 user nova-compute[82009]:   </devices>
Apr 11 18:31:16 user nova-compute[82009]: </domain>
Apr 11 18:31:16 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1458079097',display_name='tempest-AttachVolumeNegativeTest-server-1458079097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1458079097',id=39,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBneTmEZ0pN2UQnlNCBoG+jleLJbnM30xGDCQgQfFmgvBn8qq7xxOcd4Rerr6G7VYjxhDiFUwZai0A5JVSxZi4f41Ai9YF85rTqqnr5mQV8CI8ukRDiSMQwiZ6Clpof+DQ==',key_name='tempest-keypair-112673211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-b5a463ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=8f7d2851-f711-4dc2-8166-133ea16c6a1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG os_vif [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31692cb0-d0, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31692cb0-d0, col_values=(('external_ids', {'iface-id': '31692cb0-d0c2-44fc-aeb3-489ddb201839', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:34:90', 'vm-uuid': '8f7d2851-f711-4dc2-8166-133ea16c6a1b'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:16 user nova-compute[82009]: INFO os_vif [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0')
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:6d:34:90, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updated VIF entry in instance network info cache for port 31692cb0-d0c2-44fc-aeb3-489ddb201839. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG nova.network.neutron [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updating instance_info_cache with network_info: [{"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:31:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-deb081f5-0721-4455-b4a1-cf20d1a4701d req-a2d5c523-3b48-43f6-a50c-651f8a713391 service nova] Releasing lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] No waiting events found dispatching network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:31:17 user nova-compute[82009]: WARNING nova.compute.manager [req-cb4e1cec-da44-4158-9a73-bf8c6e074150 req-dc87e2fc-6017-4eea-97ff-c25ebc230f68 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received unexpected event network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance with vm_state building and task_state spawning.
Apr 11 18:31:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] No waiting events found dispatching network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:31:19 user nova-compute[82009]: WARNING nova.compute.manager [req-d9edaf7e-cf99-4854-bcf2-9e4449fc6321 req-2a03f86f-8c11-41bd-aa32-b48509a7bae3 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received unexpected event network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance with vm_state building and task_state spawning.
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237880.000256, 8f7d2851-f711-4dc2-8166-133ea16c6a1b => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] VM Resumed (Lifecycle Event)
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Instance spawned successfully.
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237880.0021374, 8f7d2851-f711-4dc2-8166-133ea16c6a1b => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] VM Started (Lifecycle Event)
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Took 6.71 seconds to spawn the instance on the hypervisor.
Apr 11 18:31:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:20 user nova-compute[82009]: INFO nova.compute.manager [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Took 7.45 seconds to build instance.
Apr 11 18:31:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-684efa6c-0f9f-4b4a-a3ab-78c5512b06d9 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.553s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:31:21 user nova-compute[82009]: INFO nova.compute.claims [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Claim successful on node user
Apr 11 18:31:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:31:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:31:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:31:22 user nova-compute[82009]: INFO nova.virt.block_device [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Booting with volume 6709e067-9e56-479d-9981-a93cbfbf9296 at /dev/vda
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.policy [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG os_brick.utils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4880d7-e64b-40c7-8804-c74f82149022]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e0be1-77e9-4aa0-a46e-de2c8daf2885]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95d6db1-ebc1-4ca4-a647-1569b620e830]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cff834-c279-4e05-826d-968cc5c5d307]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:31:22 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:31:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae3f6d-b736-4164-9534-77874b7ea979]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG os_brick.utils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:31:22 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updating existing volume attachment record: 72cb6344-1850-4ad4-a0cd-121668851d2f {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:31:23 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Successfully created port: 15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Successfully updated port: 15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquired lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-changed-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.compute.manager [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Refreshing instance network info cache due to event network-changed-15811309-acaa-4e5f-8b93-0f4511612c79. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Acquiring lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updating instance_info_cache with network_info: [{"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Releasing lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Instance network_info: |[{"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Acquired lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:31:24 user nova-compute[82009]: DEBUG nova.network.neutron [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Refreshing network info cache for port 15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:31:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updated VIF entry in instance network info cache for port 15811309-acaa-4e5f-8b93-0f4511612c79. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:31:25 user nova-compute[82009]: DEBUG nova.network.neutron [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updating instance_info_cache with network_info: [{"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:31:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c3740fd7-9d93-472e-85f5-b96d781ca04a req-5007419c-26b2-46ed-8a59-827505a06131 service nova] Releasing lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:31:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:31:27 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Creating image(s)
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Ensure instance console log exists: /opt/stack/data/nova/instances/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Start _get_guest_xml network_info=[{"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '72cb6344-1850-4ad4-a0cd-121668851d2f', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1', 'attached_at': '', 'detached_at': '', 'volume_id': '6709e067-9e56-479d-9981-a93cbfbf9296', 'serial': '6709e067-9e56-479d-9981-a93cbfbf9296'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:31:27 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:31:27 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:31:27 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:31:27 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:31:27 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[09af1a70-b8f1-4f72-8f9b-dcde33341398]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:31:27 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e243c0f-68c7-45d9-a321-2f5ff3a367e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296] added
Apr 11 18:31:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[395363bd-637a-49e7-8035-3bd155399ccb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b037c-4f96-4789-9628-7c8a843e87f1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URKwAkNr {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URKwAkNr" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b128a4-39aa-4fc8-ad1f-8dac90ff1b7d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URKwAkNr'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc7f840-cc0e-4000-8544-601f18327f92]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d771d9-194e-46d6-8c4d-d96768022e0f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:31:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:31:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd72a56-4ca3-4f9f-8473-0c7b7940cd3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]
Apr 11 18:31:27 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.
Apr 11 18:31:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e54fd3-4123-4819-a992-339149d7c294]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2ca663-0d78-44e9-b668-48645e19cb8f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:31:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:31:27 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:31:27 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3069ab06-ca8c-4823-8fcd-25666da98ce8]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:31:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23231316231313166', 'path': '/dev/sde'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231316231313166', 'path': '/dev/sde'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-416829470',display_name='tempest-TestVolumeBootPattern-server-416829470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-416829470',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-c1xg8z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:31:22Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.objects.instance [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'pci_devices' on Instance uuid 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:31:28 user nova-compute[82009]:   <uuid>91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1</uuid>
Apr 11 18:31:28 user nova-compute[82009]:   <name>instance-00000028</name>
Apr 11 18:31:28 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:31:28 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:31:28 user nova-compute[82009]:   <metadata>
Apr 11 18:31:28 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:31:28 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:31:28 user nova-compute[82009]:       <nova:name>tempest-TestVolumeBootPattern-server-416829470</nova:name>
Apr 11 18:31:28 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:31:27</nova:creationTime>
Apr 11 18:31:28 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:31:28 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:31:28 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:31:28 user nova-compute[82009]:       <nova:owner>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:user uuid="4c8825bcd5894c999412499de320dc00">tempest-TestVolumeBootPattern-1768143130-project-member</nova:user>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:project uuid="e4f6857b777f4207b93d8c28aa39054b">tempest-TestVolumeBootPattern-1768143130</nova:project>
Apr 11 18:31:28 user nova-compute[82009]:       </nova:owner>
Apr 11 18:31:28 user nova-compute[82009]:       <nova:ports>
Apr 11 18:31:28 user nova-compute[82009]:         <nova:port uuid="15811309-acaa-4e5f-8b93-0f4511612c79">
Apr 11 18:31:28 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 18:31:28 user nova-compute[82009]:         </nova:port>
Apr 11 18:31:28 user nova-compute[82009]:       </nova:ports>
Apr 11 18:31:28 user nova-compute[82009]:     </nova:instance>
Apr 11 18:31:28 user nova-compute[82009]:   </metadata>
Apr 11 18:31:28 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:31:28 user nova-compute[82009]:     <system>
Apr 11 18:31:28 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:31:28 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:31:28 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:31:28 user nova-compute[82009]:       <entry name="serial">91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1</entry>
Apr 11 18:31:28 user nova-compute[82009]:       <entry name="uuid">91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1</entry>
Apr 11 18:31:28 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:31:28 user nova-compute[82009]:     </system>
Apr 11 18:31:28 user nova-compute[82009]:   </sysinfo>
Apr 11 18:31:28 user nova-compute[82009]:   <os>
Apr 11 18:31:28 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:31:28 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:31:28 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:31:28 user nova-compute[82009]:   </os>
Apr 11 18:31:28 user nova-compute[82009]:   <features>
Apr 11 18:31:28 user nova-compute[82009]:     <acpi/>
Apr 11 18:31:28 user nova-compute[82009]:     <apic/>
Apr 11 18:31:28 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:31:28 user nova-compute[82009]:   </features>
Apr 11 18:31:28 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:31:28 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:31:28 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:31:28 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:31:28 user nova-compute[82009]:   </clock>
Apr 11 18:31:28 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:31:28 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:31:28 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:31:28 user nova-compute[82009]:   </cpu>
Apr 11 18:31:28 user nova-compute[82009]:   <devices>
Apr 11 18:31:28 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:31:28 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:31:28 user nova-compute[82009]:       <source dev="/dev/sde"/>
Apr 11 18:31:28 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:31:28 user nova-compute[82009]:       <serial>6709e067-9e56-479d-9981-a93cbfbf9296</serial>
Apr 11 18:31:28 user nova-compute[82009]:     </disk>
Apr 11 18:31:28 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:31:28 user nova-compute[82009]:       <mac address="fa:16:3e:b3:03:57"/>
Apr 11 18:31:28 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:31:28 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:31:28 user nova-compute[82009]:       <target dev="tap15811309-ac"/>
Apr 11 18:31:28 user nova-compute[82009]:     </interface>
Apr 11 18:31:28 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:31:28 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1/console.log" append="off"/>
Apr 11 18:31:28 user nova-compute[82009]:     </serial>
Apr 11 18:31:28 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:31:28 user nova-compute[82009]:     <video>
Apr 11 18:31:28 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:31:28 user nova-compute[82009]:     </video>
Apr 11 18:31:28 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:31:28 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:31:28 user nova-compute[82009]:     </rng>
Apr 11 18:31:28 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:31:28 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:31:28 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:31:28 user nova-compute[82009]:     </memballoon>
Apr 11 18:31:28 user nova-compute[82009]:   </devices>
Apr 11 18:31:28 user nova-compute[82009]: </domain>
Apr 11 18:31:28 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-416829470',display_name='tempest-TestVolumeBootPattern-server-416829470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-416829470',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-c1xg8z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:31:22Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG os_vif [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15811309-ac, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15811309-ac, col_values=(('external_ids', {'iface-id': '15811309-acaa-4e5f-8b93-0f4511612c79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:03:57', 'vm-uuid': '91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:28 user nova-compute[82009]: INFO os_vif [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac')
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:31:28 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No VIF found with MAC fa:16:3e:b3:03:57, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:31:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] No waiting events found dispatching network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:31:30 user nova-compute[82009]: WARNING nova.compute.manager [req-7f4b3b57-2769-49a9-bb38-96fb31a826f4 req-2a6c785e-6edd-4234-a008-19bc74022010 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received unexpected event network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 for instance with vm_state building and task_state spawning.
Apr 11 18:31:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237892.1263216, 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] VM Resumed (Lifecycle Event)
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Instance spawned successfully.
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237892.1310823, 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] VM Started (Lifecycle Event)
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] No waiting events found dispatching network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:31:32 user nova-compute[82009]: WARNING nova.compute.manager [req-c8dec884-c7aa-44b4-a0d0-962732be3d54 req-93092e50-67e9-4d5f-bfea-6fd7c1121168 service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received unexpected event network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 for instance with vm_state building and task_state spawning.
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 11 18:31:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:31:32 user nova-compute[82009]: INFO nova.compute.manager [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Took 10.85 seconds to build instance.
Apr 11 18:31:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cef46229-c4e3-413f-9faf-b2ed55bf9ca5 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.013s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:31:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:31:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:02 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:05 user nova-compute[82009]: INFO nova.compute.manager [None req-8c38fcd7-0305-405a-96c1-eb89f4e05859 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Get console output
Apr 11 18:32:05 user nova-compute[82009]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 18:32:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:32:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:32:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:32:09 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [{"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-d853cbf3-7869-416c-af88-0b01b498705a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:32:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:32:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:32:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8158MB free_disk=26.202919006347656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d853cbf3-7869-416c-af88-0b01b498705a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:32:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "13a5f428-afe3-495a-80f5-b72b494a064a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:32:15 user nova-compute[82009]: INFO nova.compute.claims [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Claim successful on node user
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:32:15 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:32:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:32:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:32:16 user nova-compute[82009]: INFO nova.virt.block_device [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Booting with volume-backed-image 6a1872eb-6a9a-4f78-b970-289fd877ea0f at /dev/vda
Apr 11 18:32:16 user nova-compute[82009]: DEBUG nova.policy [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fde784625fda4447afc0b8e9bd0983a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a254c432f54e1b8735e40af7063506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:32:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Successfully created port: 3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:32:16 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Successfully updated port: 3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-changed-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.compute.manager [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Refreshing instance network info cache due to event network-changed-3d45cf5a-175a-4bca-9c73-119f3456643a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Acquiring lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance network_info: |[{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Acquired lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:32:17 user nova-compute[82009]: DEBUG nova.network.neutron [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Refreshing network info cache for port 3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:32:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:32:18 user nova-compute[82009]: DEBUG nova.network.neutron [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updated VIF entry in instance network info cache for port 3d45cf5a-175a-4bca-9c73-119f3456643a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:32:18 user nova-compute[82009]: DEBUG nova.network.neutron [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:32:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-415db513-b305-4aa4-8958-36762296f64a req-febd1f95-f1e5-49ae-83cb-6f9db8ce5441 service nova] Releasing lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG os_brick.utils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d589936-0e20-4153-9cf0-c994dbb166a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ae82e3-8232-4b1f-b26e-80646242b5ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e8052-0c99-468c-a06e-995d9715c166]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec45607-1fe2-4196-bb7c-e574b85ac12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:32:21 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:32:21 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7df693-ee2e-4724-97df-daf1d9d3c487]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG os_brick.utils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:32:21 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating existing volume attachment record: d204588f-da92-4beb-9f31-e800e9bde672 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:32:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:32:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Creating image(s)
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Ensure instance console log exists: /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Start _get_guest_xml network_info=[{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd204588f-da92-4beb-9f31-e800e9bde672', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13a5f428-afe3-495a-80f5-b72b494a064a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'serial': 'e0eeb9b5-c668-49a8-9e24-7452295c3da9'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:32:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:32:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:32:26 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:32:26 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:32:26 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53841b4e-5e6c-4522-af70-9712df8d6bc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:32:26 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c4fd8-ca80-4c7f-a26e-80964e721422]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9] added
Apr 11 18:32:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[259b826e-f37e-46df-ae1d-b7a08a6a636e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f0d40-6f26-46ba-89b3-7bab2fd9dce7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLqDlgeh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLqDlgeh" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91665a6-88cf-4a16-8df0-67f5f6f1e1bf]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NLqDlgeh'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84ce1f8-61b3-41d7-a6bd-ea72f34ff81b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6fa3d5-f3f1-4805-ac38-cb66efe36a65]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361079f-6f42-48e6-9d39-32687bd3dd47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260]
Apr 11 18:32:26 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260] successful.
Apr 11 18:32:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[074f8d7c-6492-43c3-837e-c6d217eb3fb9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a95c6-9a1e-4ee6-9e1b-e5e4369efef6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:32:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd2e41-4271-4216-8f58-0ce6696faa7c]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:32:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26234656666383465', 'path': '/dev/sdf'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234656666383465', 'path': '/dev/sdf'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:32:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1226293529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1226293529',id=41,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-d6taj3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:32:16Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=13a5f428-afe3-495a-80f5-b72b494a064a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'pci_devices' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:32:27 user nova-compute[82009]:   <uuid>13a5f428-afe3-495a-80f5-b72b494a064a</uuid>
Apr 11 18:32:27 user nova-compute[82009]:   <name>instance-00000029</name>
Apr 11 18:32:27 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:32:27 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:32:27 user nova-compute[82009]:   <metadata>
Apr 11 18:32:27 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:32:27 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:32:27 user nova-compute[82009]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1226293529</nova:name>
Apr 11 18:32:27 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:32:26</nova:creationTime>
Apr 11 18:32:27 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:32:27 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:32:27 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:32:27 user nova-compute[82009]:       <nova:owner>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:user uuid="fde784625fda4447afc0b8e9bd0983a3">tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member</nova:user>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:project uuid="62a254c432f54e1b8735e40af7063506">tempest-ServerBootFromVolumeStableRescueTest-1689319261</nova:project>
Apr 11 18:32:27 user nova-compute[82009]:       </nova:owner>
Apr 11 18:32:27 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:32:27 user nova-compute[82009]:       <nova:ports>
Apr 11 18:32:27 user nova-compute[82009]:         <nova:port uuid="3d45cf5a-175a-4bca-9c73-119f3456643a">
Apr 11 18:32:27 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:32:27 user nova-compute[82009]:         </nova:port>
Apr 11 18:32:27 user nova-compute[82009]:       </nova:ports>
Apr 11 18:32:27 user nova-compute[82009]:     </nova:instance>
Apr 11 18:32:27 user nova-compute[82009]:   </metadata>
Apr 11 18:32:27 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:32:27 user nova-compute[82009]:     <system>
Apr 11 18:32:27 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:32:27 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:32:27 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:32:27 user nova-compute[82009]:       <entry name="serial">13a5f428-afe3-495a-80f5-b72b494a064a</entry>
Apr 11 18:32:27 user nova-compute[82009]:       <entry name="uuid">13a5f428-afe3-495a-80f5-b72b494a064a</entry>
Apr 11 18:32:27 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:32:27 user nova-compute[82009]:     </system>
Apr 11 18:32:27 user nova-compute[82009]:   </sysinfo>
Apr 11 18:32:27 user nova-compute[82009]:   <os>
Apr 11 18:32:27 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:32:27 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:32:27 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:32:27 user nova-compute[82009]:   </os>
Apr 11 18:32:27 user nova-compute[82009]:   <features>
Apr 11 18:32:27 user nova-compute[82009]:     <acpi/>
Apr 11 18:32:27 user nova-compute[82009]:     <apic/>
Apr 11 18:32:27 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:32:27 user nova-compute[82009]:   </features>
Apr 11 18:32:27 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:32:27 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:32:27 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:32:27 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:32:27 user nova-compute[82009]:   </clock>
Apr 11 18:32:27 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:32:27 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:32:27 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:32:27 user nova-compute[82009]:   </cpu>
Apr 11 18:32:27 user nova-compute[82009]:   <devices>
Apr 11 18:32:27 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:32:27 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:32:27 user nova-compute[82009]:       <source dev="/dev/sdf"/>
Apr 11 18:32:27 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:32:27 user nova-compute[82009]:       <serial>e0eeb9b5-c668-49a8-9e24-7452295c3da9</serial>
Apr 11 18:32:27 user nova-compute[82009]:     </disk>
Apr 11 18:32:27 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:32:27 user nova-compute[82009]:       <mac address="fa:16:3e:db:18:61"/>
Apr 11 18:32:27 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:32:27 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:32:27 user nova-compute[82009]:       <target dev="tap3d45cf5a-17"/>
Apr 11 18:32:27 user nova-compute[82009]:     </interface>
Apr 11 18:32:27 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:32:27 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/console.log" append="off"/>
Apr 11 18:32:27 user nova-compute[82009]:     </serial>
Apr 11 18:32:27 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:32:27 user nova-compute[82009]:     <video>
Apr 11 18:32:27 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:32:27 user nova-compute[82009]:     </video>
Apr 11 18:32:27 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:32:27 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:32:27 user nova-compute[82009]:     </rng>
Apr 11 18:32:27 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:32:27 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:32:27 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:32:27 user nova-compute[82009]:     </memballoon>
Apr 11 18:32:27 user nova-compute[82009]:   </devices>
Apr 11 18:32:27 user nova-compute[82009]: </domain>
Apr 11 18:32:27 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:32:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1226293529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1226293529',id=41,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-d6taj3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:32:16Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=13a5f428-afe3-495a-80f5-b72b494a064a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG os_vif [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d45cf5a-17, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d45cf5a-17, col_values=(('external_ids', {'iface-id': '3d45cf5a-175a-4bca-9c73-119f3456643a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:18:61', 'vm-uuid': '13a5f428-afe3-495a-80f5-b72b494a064a'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:27 user nova-compute[82009]: INFO os_vif [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17')
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:32:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No VIF found with MAC fa:16:3e:db:18:61, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:32:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:32:29 user nova-compute[82009]: WARNING nova.compute.manager [req-c3496f0a-626f-4878-a190-c276770db9e6 req-8aadce3e-e84e-4923-a163-08cfafb6a9c9 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state building and task_state spawning.
Apr 11 18:32:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237951.064494, 13a5f428-afe3-495a-80f5-b72b494a064a => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Resumed (Lifecycle Event)
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance spawned successfully.
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681237951.06611, 13a5f428-afe3-495a-80f5-b72b494a064a => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Started (Lifecycle Event)
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Took 4.96 seconds to spawn the instance on the hypervisor.
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:32:31 user nova-compute[82009]: INFO nova.compute.manager [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Took 15.74 seconds to build instance.
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:32:31 user nova-compute[82009]: WARNING nova.compute.manager [req-f3351f15-51c2-4f7f-831e-9bc45678d0a5 req-d523337e-38ff-48f5-97c8-2a05d87ff126 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state None.
Apr 11 18:32:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f2e2ec07-fc36-4603-b4b2-dd6309f61f72 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "13a5f428-afe3-495a-80f5-b72b494a064a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.863s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:32:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:32:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:32:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:32:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:32:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:32:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:32:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:32:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:32:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:32:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:02 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-changed-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Refreshing instance network info cache due to event network-changed-31692cb0-d0c2-44fc-aeb3-489ddb201839. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Acquiring lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Acquired lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Refreshing network info cache for port 31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:03 user nova-compute[82009]: INFO nova.compute.manager [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Terminating instance
Apr 11 18:33:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-vif-unplugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] No waiting events found dispatching network-vif-unplugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-e6228104-fdcf-4a41-b6d4-dc950d4e3679 req-cdf96630-ac77-4a0a-8597-330591396afd service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-vif-unplugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updated VIF entry in instance network info cache for port 31692cb0-d0c2-44fc-aeb3-489ddb201839. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updating instance_info_cache with network_info: [{"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7d938a52-2a56-431b-b3ef-422bb65f5b49 req-ea335030-9e05-4529-a836-c20884fab93d service nova] Releasing lock "refresh_cache-8f7d2851-f711-4dc2-8166-133ea16c6a1b" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:33:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Instance destroyed successfully.
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'resources' on Instance uuid 8f7d2851-f711-4dc2-8166-133ea16c6a1b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1458079097',display_name='tempest-AttachVolumeNegativeTest-server-1458079097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1458079097',id=39,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBneTmEZ0pN2UQnlNCBoG+jleLJbnM30xGDCQgQfFmgvBn8qq7xxOcd4Rerr6G7VYjxhDiFUwZai0A5JVSxZi4f41Ai9YF85rTqqnr5mQV8CI8ukRDiSMQwiZ6Clpof+DQ==',key_name='tempest-keypair-112673211',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-b5a463ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=8f7d2851-f711-4dc2-8166-133ea16c6a1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "address": "fa:16:3e:6d:34:90", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31692cb0-d0", "ovs_interfaceid": "31692cb0-d0c2-44fc-aeb3-489ddb201839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG os_vif [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31692cb0-d0, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:33:04 user nova-compute[82009]: INFO os_vif [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:34:90,bridge_name='br-int',has_traffic_filtering=True,id=31692cb0-d0c2-44fc-aeb3-489ddb201839,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31692cb0-d0')
Apr 11 18:33:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Deleting instance files /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b_del
Apr 11 18:33:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Deletion of /opt/stack/data/nova/instances/8f7d2851-f711-4dc2-8166-133ea16c6a1b_del complete
Apr 11 18:33:04 user nova-compute[82009]: INFO nova.compute.manager [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 18:33:04 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:33:04 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:05 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Took 0.75 seconds to deallocate network for instance.
Apr 11 18:33:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-vif-deleted-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:05 user nova-compute[82009]: INFO nova.compute.manager [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Neutron deleted interface 31692cb0-d0c2-44fc-aeb3-489ddb201839; detaching it from the instance and deleting it from the info cache
Apr 11 18:33:05 user nova-compute[82009]: DEBUG nova.network.neutron [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-159857d2-e581-47c0-837f-6d1b8ec2b12d req-e8a08f86-1a5c-4480-9194-7eb569cc8dda service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Detach interface failed, port_id=31692cb0-d0c2-44fc-aeb3-489ddb201839, reason: Instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:33:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:05 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Deleted allocations for instance 8f7d2851-f711-4dc2-8166-133ea16c6a1b
Apr 11 18:33:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4faa784c-8f73-4b1b-9ad6-78dbfff27668 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.984s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:06 user nova-compute[82009]: INFO nova.compute.manager [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Terminating instance
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.compute.manager [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received event network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Acquiring lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] Lock "8f7d2851-f711-4dc2-8166-133ea16c6a1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] No waiting events found dispatching network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:06 user nova-compute[82009]: WARNING nova.compute.manager [req-d84eeac8-1002-4a44-80f0-6e69ac22001d req-0651ee60-4ef7-4308-ba33-8fbc73b69368 service nova] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Received unexpected event network-vif-plugged-31692cb0-d0c2-44fc-aeb3-489ddb201839 for instance with vm_state deleted and task_state None.
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Instance destroyed successfully.
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.objects.instance [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid d853cbf3-7869-416c-af88-0b01b498705a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1486538402',display_name='tempest-ServerActionsTestJSON-server-1486538402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1486538402',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-5rr47ocf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=d853cbf3-7869-416c-af88-0b01b498705a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "address": "fa:16:3e:bb:b5:bc", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd983c712-08", "ovs_interfaceid": "d983c712-087e-4bf3-a5c9-98ae1eea11ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_vif [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd983c712-08, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:06 user nova-compute[82009]: INFO os_vif [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b5:bc,bridge_name='br-int',has_traffic_filtering=True,id=d983c712-087e-4bf3-a5c9-98ae1eea11ac,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd983c712-08')
Apr 11 18:33:06 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvasrCSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:33:06 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f5420-3456-483f-84a7-b15ba85fadfe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:33:06 user nova-compute[82009]: No targets found.
Apr 11 18:33:06 user nova-compute[82009]: iSNS:
Apr 11 18:33:06 user nova-compute[82009]: No targets found.
Apr 11 18:33:06 user nova-compute[82009]: STATIC:
Apr 11 18:33:06 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:33:06 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:06 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:06 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:33:06 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:06 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:06 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b
Apr 11 18:33:06 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:06 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:06 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296
Apr 11 18:33:06 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:06 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:06 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc
Apr 11 18:33:06 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:06 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:06 user nova-compute[82009]: FIRMWARE:
Apr 11 18:33:06 user nova-compute[82009]: No targets found.
Apr 11 18:33:06 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:33:06 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:33:06 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c9b49-005b-4800-932d-49e66d192a9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b6a9f-2167-4bb4-8b61-a87f8380e17f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:06 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:06 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:06 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6cb16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:33:06 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ef31d-ab9f-4697-a148-a51d9b9da2cd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d993fb-77b2-475c-9902-3f9a94a5d9d3]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9eaaee-34df-4696-ae90-864436be43b9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a7e394-191f-4fbd-b8b5-dfede2909c65]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26230346638333135', '/dev/disk/by-id/scsi-1SCST_BIO62fcd6e4-b04f83150fa7200d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_62fcd6e4') {{(pid=92248) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0359bda-cf96-4de5-a26b-ba839ed5d89e]: (4, None) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5861e7-e300-4b35-8f03-b70f34bcfcf5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a092315-dd75-4600-af7f-9c64e7a598a1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260]
Apr 11 18:33:07 user nova-compute[82009]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b, portal: 172.16.0.220,3260] successful.
Apr 11 18:33:07 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb51b2ca-fd24-41b8-bc39-fc11e130b55b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a1d000-a881-485e-aa8a-5325423b453c]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] <== disconnect_volume: return (318ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:33:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Deleting instance files /opt/stack/data/nova/instances/d853cbf3-7869-416c-af88-0b01b498705a_del
Apr 11 18:33:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Deletion of /opt/stack/data/nova/instances/d853cbf3-7869-416c-af88-0b01b498705a_del complete
Apr 11 18:33:07 user nova-compute[82009]: INFO nova.compute.manager [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-unplugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-unplugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-unplugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Acquiring lock "d853cbf3-7869-416c-af88-0b01b498705a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] Lock "d853cbf3-7869-416c-af88-0b01b498705a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] No waiting events found dispatching network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:07 user nova-compute[82009]: WARNING nova.compute.manager [req-4b3f2f71-c687-4a2b-8c4d-dd9d6b233655 req-64ac7184-07a3-4b92-abab-13e3a9613b08 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received unexpected event network-vif-plugged-d983c712-087e-4bf3-a5c9-98ae1eea11ac for instance with vm_state active and task_state deleting.
Apr 11 18:33:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:07 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:08 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:08 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Took 0.70 seconds to deallocate network for instance.
Apr 11 18:33:08 user nova-compute[82009]: INFO nova.compute.manager [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Took 0.86 seconds to detach 1 volumes for instance.
Apr 11 18:33:08 user nova-compute[82009]: DEBUG nova.compute.manager [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Deleting volume: eb51b2ca-fd24-41b8-bc39-fc11e130b55b {{(pid=82009) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 18:33:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:08 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:09 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:33:09 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:33:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:09 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Deleted allocations for instance d853cbf3-7869-416c-af88-0b01b498705a
Apr 11 18:33:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-35ea08ba-abb1-469d-8b33-0a0c24fd030b tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "d853cbf3-7869-416c-af88-0b01b498705a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-8273a9df-e547-43e5-b94e-eca708cdd116 req-5ce4727f-4ecc-4f6b-904d-651299478be3 service nova] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Received event network-vif-deleted-d983c712-087e-4bf3-a5c9-98ae1eea11ac {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:10 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:33:12 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8170MB free_disk=26.212501525878906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance b2175ccc-960d-4eca-8e41-3783cf28410b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 13a5f428-afe3-495a-80f5-b72b494a064a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:33:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-changed-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Refreshing instance network info cache due to event network-changed-15811309-acaa-4e5f-8b93-0f4511612c79. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Acquiring lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Acquired lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Refreshing network info cache for port 15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updated VIF entry in instance network info cache for port 15811309-acaa-4e5f-8b93-0f4511612c79. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG nova.network.neutron [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updating instance_info_cache with network_info: [{"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5fd26a0d-23ac-444c-86e4-d038658b94a2 req-7e6a5a30-dca6-4a44-b4e0-18c1619e0ebb service nova] Releasing lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:33:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:33:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:16 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:33:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:33:17 user nova-compute[82009]: INFO nova.compute.claims [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Claim successful on node user
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:33:17 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:33:17 user nova-compute[82009]: INFO nova.virt.block_device [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Booting with volume 9b95fd41-cafd-4f63-b6cc-ba35d89aac56 at /dev/vda
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.policy [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c8825bcd5894c999412499de320dc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f6857b777f4207b93d8c28aa39054b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG os_brick.utils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ab23b1-390a-45f3-8c73-a79ae95817f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8ae4e7-e197-4a93-8058-cd40f59ece93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a97d1f-7dd0-4472-b962-21076490ed2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3266ca70-494f-44c5-a68e-2f2113b5f050]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:33:17 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:33:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b2886-8d7a-47d2-baeb-d14ebf0b1bdc]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG os_brick.utils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:33:17 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updating existing volume attachment record: 63db4e94-398a-454d-b787-73d672347b29 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:33:18 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Successfully created port: 95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237984.504259, 8f7d2851-f711-4dc2-8166-133ea16c6a1b => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:33:19 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] VM Stopped (Lifecycle Event)
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-622479a8-8752-402a-ac57-9f075e187e77 None None] [instance: 8f7d2851-f711-4dc2-8166-133ea16c6a1b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Successfully updated port: 95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquired lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-changed-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.compute.manager [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Refreshing instance network info cache due to event network-changed-95038301-4dc6-4a03-ad63-c17301be86c7. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Acquiring lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:33:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG nova.network.neutron [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updating instance_info_cache with network_info: [{"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Releasing lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Instance network_info: |[{"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Acquired lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Refreshing network info cache for port 95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updated VIF entry in instance network info cache for port 95038301-4dc6-4a03-ad63-c17301be86c7. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG nova.network.neutron [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updating instance_info_cache with network_info: [{"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-2b46bce2-0c4c-4425-bf5f-e6535793ad85 req-71133435-2c81-49c9-a28f-91e9b69e5a39 service nova] Releasing lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:33:21 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681237986.864669, d853cbf3-7869-416c-af88-0b01b498705a => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:33:21 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: d853cbf3-7869-416c-af88-0b01b498705a] VM Stopped (Lifecycle Event)
Apr 11 18:33:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-5f82dd59-e216-4bad-9aaf-5500c41ce86b None None] [instance: d853cbf3-7869-416c-af88-0b01b498705a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:33:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:33:22 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Creating image(s)
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Did not create local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Ensure instance console log exists: /opt/stack/data/nova/instances/73e532c0-b6d3-49c5-8ee2-371d1423abda/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Start _get_guest_xml network_info=[{"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '63db4e94-398a-454d-b787-73d672347b29', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLjFbyXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73e532c0-b6d3-49c5-8ee2-371d1423abda', 'attached_at': '', 'detached_at': '', 'volume_id': '9b95fd41-cafd-4f63-b6cc-ba35d89aac56', 'serial': '9b95fd41-cafd-4f63-b6cc-ba35d89aac56'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:33:22 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:33:22 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLjFbyXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:33:22 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:33:22 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:33:22 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1849610d-ca83-4fd0-909a-0fb6966b2533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:33:22 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd45e4-619d-4b0f-938f-8f6a607d1e1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56] added
Apr 11 18:33:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c10c37f-d630-4a31-8bcb-a1411fb1802d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ab0965-d034-4afe-b727-fe9499e95fc1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLjFbyXN {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLjFbyXN" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[775153bf-a285-482a-950f-fd3bfcf0c384]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLjFbyXN'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a6dd86-601a-4222-8832-d2d5f4994561]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d954a9f-c505-4837-9aa4-a1604e2f2d81]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[588bb0ea-e8f8-4d66-a6b3-fe147c9ddf0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260]
Apr 11 18:33:22 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260] successful.
Apr 11 18:33:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[006815be-940c-4ba4-8728-51c212608bf3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb128b-3a02-4176-9302-c060aae112d2]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:33:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc4c94-6926-4f39-9158-179a30ef8830]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:33:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLjFbyXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23864633139653030', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864633139653030', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1811728730',display_name='tempest-TestVolumeBootPattern-server-1811728730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1811728730',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-ivhluy8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:33:18Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=73e532c0-b6d3-49c5-8ee2-371d1423abda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'pci_devices' on Instance uuid 73e532c0-b6d3-49c5-8ee2-371d1423abda {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:33:23 user nova-compute[82009]:   <uuid>73e532c0-b6d3-49c5-8ee2-371d1423abda</uuid>
Apr 11 18:33:23 user nova-compute[82009]:   <name>instance-0000002a</name>
Apr 11 18:33:23 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:33:23 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:33:23 user nova-compute[82009]:   <metadata>
Apr 11 18:33:23 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:33:23 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:33:23 user nova-compute[82009]:       <nova:name>tempest-TestVolumeBootPattern-server-1811728730</nova:name>
Apr 11 18:33:23 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:33:22</nova:creationTime>
Apr 11 18:33:23 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:33:23 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:33:23 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:33:23 user nova-compute[82009]:       <nova:owner>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:user uuid="4c8825bcd5894c999412499de320dc00">tempest-TestVolumeBootPattern-1768143130-project-member</nova:user>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:project uuid="e4f6857b777f4207b93d8c28aa39054b">tempest-TestVolumeBootPattern-1768143130</nova:project>
Apr 11 18:33:23 user nova-compute[82009]:       </nova:owner>
Apr 11 18:33:23 user nova-compute[82009]:       <nova:ports>
Apr 11 18:33:23 user nova-compute[82009]:         <nova:port uuid="95038301-4dc6-4a03-ad63-c17301be86c7">
Apr 11 18:33:23 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 18:33:23 user nova-compute[82009]:         </nova:port>
Apr 11 18:33:23 user nova-compute[82009]:       </nova:ports>
Apr 11 18:33:23 user nova-compute[82009]:     </nova:instance>
Apr 11 18:33:23 user nova-compute[82009]:   </metadata>
Apr 11 18:33:23 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:33:23 user nova-compute[82009]:     <system>
Apr 11 18:33:23 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:33:23 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:33:23 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:33:23 user nova-compute[82009]:       <entry name="serial">73e532c0-b6d3-49c5-8ee2-371d1423abda</entry>
Apr 11 18:33:23 user nova-compute[82009]:       <entry name="uuid">73e532c0-b6d3-49c5-8ee2-371d1423abda</entry>
Apr 11 18:33:23 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:33:23 user nova-compute[82009]:     </system>
Apr 11 18:33:23 user nova-compute[82009]:   </sysinfo>
Apr 11 18:33:23 user nova-compute[82009]:   <os>
Apr 11 18:33:23 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:33:23 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:33:23 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:33:23 user nova-compute[82009]:   </os>
Apr 11 18:33:23 user nova-compute[82009]:   <features>
Apr 11 18:33:23 user nova-compute[82009]:     <acpi/>
Apr 11 18:33:23 user nova-compute[82009]:     <apic/>
Apr 11 18:33:23 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:33:23 user nova-compute[82009]:   </features>
Apr 11 18:33:23 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:33:23 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:33:23 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:33:23 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:33:23 user nova-compute[82009]:   </clock>
Apr 11 18:33:23 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:33:23 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:33:23 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:33:23 user nova-compute[82009]:   </cpu>
Apr 11 18:33:23 user nova-compute[82009]:   <devices>
Apr 11 18:33:23 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:33:23 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:33:23 user nova-compute[82009]:       <source dev="/dev/sdb"/>
Apr 11 18:33:23 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:33:23 user nova-compute[82009]:       <serial>9b95fd41-cafd-4f63-b6cc-ba35d89aac56</serial>
Apr 11 18:33:23 user nova-compute[82009]:     </disk>
Apr 11 18:33:23 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:33:23 user nova-compute[82009]:       <mac address="fa:16:3e:ee:5c:7b"/>
Apr 11 18:33:23 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:33:23 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:33:23 user nova-compute[82009]:       <target dev="tap95038301-4d"/>
Apr 11 18:33:23 user nova-compute[82009]:     </interface>
Apr 11 18:33:23 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:33:23 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/73e532c0-b6d3-49c5-8ee2-371d1423abda/console.log" append="off"/>
Apr 11 18:33:23 user nova-compute[82009]:     </serial>
Apr 11 18:33:23 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:33:23 user nova-compute[82009]:     <video>
Apr 11 18:33:23 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:33:23 user nova-compute[82009]:     </video>
Apr 11 18:33:23 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:33:23 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:33:23 user nova-compute[82009]:     </rng>
Apr 11 18:33:23 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:33:23 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:33:23 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:33:23 user nova-compute[82009]:     </memballoon>
Apr 11 18:33:23 user nova-compute[82009]:   </devices>
Apr 11 18:33:23 user nova-compute[82009]: </domain>
Apr 11 18:33:23 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1811728730',display_name='tempest-TestVolumeBootPattern-server-1811728730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1811728730',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-ivhluy8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:33:18Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=73e532c0-b6d3-49c5-8ee2-371d1423abda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG os_vif [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95038301-4d, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95038301-4d, col_values=(('external_ids', {'iface-id': '95038301-4dc6-4a03-ad63-c17301be86c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:5c:7b', 'vm-uuid': '73e532c0-b6d3-49c5-8ee2-371d1423abda'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:23 user nova-compute[82009]: INFO os_vif [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d')
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:33:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] No VIF found with MAC fa:16:3e:ee:5c:7b, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] No waiting events found dispatching network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:25 user nova-compute[82009]: WARNING nova.compute.manager [req-6bcdb45b-d9c0-4e38-9c68-0ab546b99358 req-db321949-71c8-4003-ac2b-f0d410a55769 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received unexpected event network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 for instance with vm_state building and task_state spawning.
Apr 11 18:33:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238007.3688464, 73e532c0-b6d3-49c5-8ee2-371d1423abda => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] VM Resumed (Lifecycle Event)
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Instance spawned successfully.
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238007.3717573, 73e532c0-b6d3-49c5-8ee2-371d1423abda => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] VM Started (Lifecycle Event)
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] No waiting events found dispatching network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:27 user nova-compute[82009]: WARNING nova.compute.manager [req-d51c720b-90d2-45db-a930-99bac1bd4b96 req-c1b2134f-2b12-408f-a35e-d5fa337705b5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received unexpected event network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 for instance with vm_state building and task_state spawning.
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Took 5.03 seconds to spawn the instance on the hypervisor.
Apr 11 18:33:27 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:33:27 user nova-compute[82009]: INFO nova.compute.manager [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Took 10.46 seconds to build instance.
Apr 11 18:33:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9242433a-fc72-4bc6-927d-3954d4ccf427 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.551s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:33:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:33:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:55 user nova-compute[82009]: INFO nova.compute.manager [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Detaching volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc
Apr 11 18:33:55 user nova-compute[82009]: INFO nova.virt.block_device [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Attempting to driver detach volume 1a2b3d37-c5ab-4df4-9135-e366c9c642dc from mountpoint /dev/vdb
Apr 11 18:33:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Attempting to detach device vdb from instance fbf10cce-a01c-4e3f-8212-a2a0d42713df from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:33:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:33:55 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:33:55 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:33:55 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:33:55 user nova-compute[82009]:   <serial>1a2b3d37-c5ab-4df4-9135-e366c9c642dc</serial>
Apr 11 18:33:55 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:33:55 user nova-compute[82009]: </disk>
Apr 11 18:33:55 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:33:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully detached device vdb from instance fbf10cce-a01c-4e3f-8212-a2a0d42713df from the persistent domain config.
Apr 11 18:33:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbf10cce-a01c-4e3f-8212-a2a0d42713df from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:33:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:33:55 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:33:55 user nova-compute[82009]:   <source dev="/dev/sdd"/>
Apr 11 18:33:55 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:33:55 user nova-compute[82009]:   <serial>1a2b3d37-c5ab-4df4-9135-e366c9c642dc</serial>
Apr 11 18:33:55 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:33:55 user nova-compute[82009]: </disk>
Apr 11 18:33:55 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238036.3286827, fbf10cce-a01c-4e3f-8212-a2a0d42713df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:33:56 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully detached device vdb from instance fbf10cce-a01c-4e3f-8212-a2a0d42713df from the live domain config.
Apr 11 18:33:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJKckbuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:33:56 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[282992ff-9c5d-4719-842f-172809ecf681]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:33:56 user nova-compute[82009]: No targets found.
Apr 11 18:33:56 user nova-compute[82009]: iSNS:
Apr 11 18:33:56 user nova-compute[82009]: No targets found.
Apr 11 18:33:56 user nova-compute[82009]: STATIC:
Apr 11 18:33:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:33:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:33:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56
Apr 11 18:33:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296
Apr 11 18:33:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:56 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc
Apr 11 18:33:56 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:33:56 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:33:56 user nova-compute[82009]: FIRMWARE:
Apr 11 18:33:56 user nova-compute[82009]: No targets found.
Apr 11 18:33:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:33:56 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:33:56 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3c3b79-1177-4ba4-a42f-f76ee01b2fb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998889e-62d9-4de0-9332-002b1f82ec32]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:33:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d81eab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc'): ({'sdd'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Removing single pathed devices sdd {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[918bc4e2-b28f-4225-bde1-3569bae57c78]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d578a34-063f-43cc-8a96-56c08781f264]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flushing IO for device /dev/sdd {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdc1502-0fef-4b35-8d85-6956392f7708]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d10517-087f-471f-b1f6-494f503aa4ba]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] SCSI volumes sdd have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193b4d9-071b-4032-a579-822e4a6dc997]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ad920-9b7a-41b8-ad0e-222bc53ba482]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260]
Apr 11 18:33:56 user nova-compute[82009]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc, portal: 172.16.0.220,3260] successful.
Apr 11 18:33:56 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a2b3d37-c5ab-4df4-9135-e366c9c642dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058c68e-f955-475d-8e98-645897e6aebf]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== disconnect_volume: return (334ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:56 user nova-compute[82009]: INFO nova.compute.manager [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Terminating instance
Apr 11 18:33:56 user nova-compute[82009]: DEBUG nova.compute.manager [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-vif-unplugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] No waiting events found dispatching network-vif-unplugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0bf4235-4ff0-4889-b685-a7a00aa5c552 req-626ab76d-750a-4d5e-a1b0-7ecaf03c3ae5 service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-vif-unplugged-e146b0b2-5c30-4253-845d-2533c2961fcc for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Instance destroyed successfully.
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lazy-loading 'resources' on Instance uuid b2175ccc-960d-4eca-8e41-3783cf28410b {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2109686306',display_name='tempest-ServerActionsTestJSON-server-2109686306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2109686306',id=32,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjasu/O/k7NPLKF4wXxtGx+Vm3Ylukwsux6pf5hHEfHTVFYFAVv0VnQ1136HZDvl6bPbDXT41SsITA33e6mI08JWlGStublkFFbVNhOsVHqxSDHj5mmTVR6kHtecjx7ew==',key_name='tempest-keypair-154558437',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e49c5486b65e4d3eaab7c35fe84ac9c9',ramdisk_id='',reservation_id='r-pexzg0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1277136387',owner_user_name='tempest-ServerActionsTestJSON-1277136387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ea51d683a9e45529a4eafc2359be9c8',uuid=b2175ccc-960d-4eca-8e41-3783cf28410b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converting VIF {"id": "e146b0b2-5c30-4253-845d-2533c2961fcc", "address": "fa:16:3e:b5:6a:54", "network": {"id": "6960067f-92d2-4975-8467-4b8d4d2f9933", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-817403215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e49c5486b65e4d3eaab7c35fe84ac9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape146b0b2-5c", "ovs_interfaceid": "e146b0b2-5c30-4253-845d-2533c2961fcc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG os_vif [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape146b0b2-5c, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:33:57 user nova-compute[82009]: INFO os_vif [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:6a:54,bridge_name='br-int',has_traffic_filtering=True,id=e146b0b2-5c30-4253-845d-2533c2961fcc,network=Network(6960067f-92d2-4975-8467-4b8d4d2f9933),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape146b0b2-5c')
Apr 11 18:33:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Deleting instance files /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b_del
Apr 11 18:33:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Deletion of /opt/stack/data/nova/instances/b2175ccc-960d-4eca-8e41-3783cf28410b_del complete
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-917530b2-fc97-44eb-a6ef-a29feb3e3bed tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:57 user nova-compute[82009]: INFO nova.compute.manager [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 18:33:57 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:33:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:33:58 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:33:58 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Took 0.49 seconds to deallocate network for instance.
Apr 11 18:33:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:58 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:33:58 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:33:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:58 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Deleted allocations for instance b2175ccc-960d-4eca-8e41-3783cf28410b
Apr 11 18:33:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1a2c560d-081f-49dc-b4c2-c8b2f92dfae3 tempest-ServerActionsTestJSON-1277136387 tempest-ServerActionsTestJSON-1277136387-project-member] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:33:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Acquiring lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:33:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:33:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] Lock "b2175ccc-960d-4eca-8e41-3783cf28410b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:33:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] No waiting events found dispatching network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:33:59 user nova-compute[82009]: WARNING nova.compute.manager [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received unexpected event network-vif-plugged-e146b0b2-5c30-4253-845d-2533c2961fcc for instance with vm_state deleted and task_state None.
Apr 11 18:33:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-c45059e1-09b7-48f4-864c-cf275e220df2 req-fc201871-d2c9-48d8-a9bc-47a02cdaeb1d service nova] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Received event network-vif-deleted-e146b0b2-5c30-4253-845d-2533c2961fcc {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:06 user nova-compute[82009]: INFO nova.compute.manager [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Rescuing
Apr 11 18:34:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:34:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:34:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:34:06 user nova-compute[82009]: DEBUG nova.network.neutron [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:34:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:34:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:07 user nova-compute[82009]: WARNING nova.compute.manager [req-fd4a880a-6ba8-4a57-981e-fe17bdd37ab0 req-f109c898-c44f-4cbd-b97b-b6caf7764b4e service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance destroyed successfully.
Apr 11 18:34:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Attempting a stable device rescue
Apr 11 18:34:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82009) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance directory exists: not creating {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 18:34:07 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Creating image(s)
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "/opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "/opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f64dd5d69c8f66384426f236d55f6fc78a9c6232" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f64dd5d69c8f66384426f236d55f6fc78a9c6232" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.part --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.part --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG nova.virt.images [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] 909d8608-beaa-4443-b4e2-94783ce5dadb was qcow2, converting to raw {{(pid=82009) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG nova.privsep.utils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82009) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.part /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.converted {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.part /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.converted" returned: 0 in 0.417s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.converted --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.compute.manager [req-39a8d76b-3cf2-4d87-aa0a-0c8f22ecbaeb req-8f2fafa0-f031-4155-9755-69a14d84071b service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f64dd5d69c8f66384426f236d55f6fc78a9c6232" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.479s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "f64dd5d69c8f66384426f236d55f6fc78a9c6232" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f64dd5d69c8f66384426f236d55f6fc78a9c6232" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232 --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232,backing_fmt=raw /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232,backing_fmt=raw /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "f64dd5d69c8f66384426f236d55f6fc78a9c6232" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'migration_context' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Start _get_guest_xml network_info=[{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "vif_mac": "fa:16:3e:db:18:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '909d8608-beaa-4443-b4e2-94783ce5dadb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd204588f-da92-4beb-9f31-e800e9bde672', 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '13a5f428-afe3-495a-80f5-b72b494a064a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'serial': 'e0eeb9b5-c668-49a8-9e24-7452295c3da9'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'resources' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'numa_topology' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:34:09 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:34:09 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:34:09 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94237924-1eb3-4508-9522-e7a41f397c92]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NLqDlgeh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 18:34:09 user nova-compute[82009]: node.name = iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:34:09 user nova-compute[82009]: node.tpgt = -1
Apr 11 18:34:09 user nova-compute[82009]: node.startup = automatic
Apr 11 18:34:09 user nova-compute[82009]: node.leading_login = No
Apr 11 18:34:09 user nova-compute[82009]: iface.iscsi_ifacename = default
Apr 11 18:34:09 user nova-compute[82009]: iface.net_ifacename = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.ipaddress = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.prefix_len = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.hwaddress = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.transport_name = tcp
Apr 11 18:34:09 user nova-compute[82009]: iface.initiatorname = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.vlan_id = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.vlan_priority = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.vlan_state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.iface_num = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.mtu = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.port = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.bootproto = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.subnet_mask = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.gateway = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_alt_client_id = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_dns = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_learn_iqn = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_vendor_id_state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_vendor_id = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.dhcp_slp_da = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.fragmentation = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.gratuitous_arp = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.incoming_forwarding = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.tos_state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.tos = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.ttl = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.delayed_ack = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.tcp_nagle = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.tcp_wsf_state = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.tcp_wsf = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.tcp_timer_scale = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.tcp_timestamp = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.redirect = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.def_task_mgmt_timeout = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.header_digest = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.data_digest = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.immediate_data = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.initial_r2t = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.data_seq_inorder = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.data_pdu_inorder = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.erl = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.max_receive_data_len = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.first_burst_len = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.max_outstanding_r2t = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.max_burst_len = 0
Apr 11 18:34:09 user nova-compute[82009]: iface.chap_auth = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.bidi_chap = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.strict_login_compliance = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.discovery_auth = <empty>
Apr 11 18:34:09 user nova-compute[82009]: iface.discovery_logout = <empty>
Apr 11 18:34:09 user nova-compute[82009]: node.discovery_address = <empty>
Apr 11 18:34:09 user nova-compute[82009]: node.discovery_port = 0
Apr 11 18:34:09 user nova-compute[82009]: node.discovery_type = static
Apr 11 18:34:09 user nova-compute[82009]: node.session.initial_cmdsn = 0
Apr 11 18:34:09 user nova-compute[82009]: node.session.initial_login_retry_max = 8
Apr 11 18:34:09 user nova-compute[82009]: node.session.xmit_thread_priority = -20
Apr 11 18:34:09 user nova-compute[82009]: node.session.cmds_max = 128
Apr 11 18:34:09 user nova-compute[82009]: node.session.queue_depth = 32
Apr 11 18:34:09 user nova-compute[82009]: node.session.nr_sessions = 1
Apr 11 18:34:09 user nova-compute[82009]: node.session.auth.authmethod = CHAP
Apr 11 18:34:09 user nova-compute[82009]: node.session.auth.username = NLqDlgeh
Apr 11 18:34:09 user nova-compute[82009]: node.session.auth.password = ***
Apr 11 18:34:09 user nova-compute[82009]: node.session.auth.username_in = <empty>
Apr 11 18:34:09 user nova-compute[82009]: node.session.auth.password_in = <empty>
Apr 11 18:34:09 user nova-compute[82009]: node.session.auth.chap_algs = MD5
Apr 11 18:34:09 user nova-compute[82009]: node.session.timeo.replacement_timeout = 120
Apr 11 18:34:09 user nova-compute[82009]: node.session.err_timeo.abort_timeout = 15
Apr 11 18:34:09 user nova-compute[82009]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 18:34:09 user nova-compute[82009]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 18:34:09 user nova-compute[82009]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.FastAbort = Yes
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.InitialR2T = No
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.ImmediateData = Yes
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.MaxConnections = 1
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 18:34:09 user nova-compute[82009]: node.session.iscsi.ERL = 0
Apr 11 18:34:09 user nova-compute[82009]: node.session.scan = manual
Apr 11 18:34:09 user nova-compute[82009]: node.session.reopen_max = 0
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].address = 172.16.0.220
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].port = 3260
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].startup = manual
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].tcp.window_size = 524288
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].tcp.type_of_service = 0
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].timeo.logout_timeout = 15
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].timeo.login_timeout = 15
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].timeo.auth_timeout = 45
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].iscsi.DataDigest = None
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].iscsi.IFMarker = No
Apr 11 18:34:09 user nova-compute[82009]: node.conn[0].iscsi.OFMarker = No
Apr 11 18:34:09 user nova-compute[82009]: # END RECORD
Apr 11 18:34:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a2d302-b907-439b-88ed-77566daa08dd]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1496642-6fa5-4f19-859e-baf4aabbb018]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLqDlgeh {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NLqDlgeh" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8729dcb8-694a-48dc-8554-52e54284fcfb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NLqDlgeh'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fe2518-f38c-4f9f-aebc-e62058335f9a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[55de2b5b-995f-4705-bf46-16be6f9b94f9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:34:09 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] HCTL ('37', '0', '0', 0) found on session 47 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e76ad82-b693-4229-8ec6-479ee6afcbfa]: (4, ('0 0 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Searching for a device in session 47 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26234656666383465', 'path': '/dev/sdf'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234656666383465', 'path': '/dev/sdf'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:32:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1226293529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1226293529',id=41,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-d6taj3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:32:31Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=13a5f428-afe3-495a-80f5-b72b494a064a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "vif_mac": "fa:16:3e:db:18:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "vif_mac": "fa:16:3e:db:18:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.objects.instance [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'pci_devices' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:34:09 user nova-compute[82009]:   <uuid>13a5f428-afe3-495a-80f5-b72b494a064a</uuid>
Apr 11 18:34:09 user nova-compute[82009]:   <name>instance-00000029</name>
Apr 11 18:34:09 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:34:09 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:34:09 user nova-compute[82009]:   <metadata>
Apr 11 18:34:09 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:34:09 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:34:09 user nova-compute[82009]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1226293529</nova:name>
Apr 11 18:34:09 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:34:09</nova:creationTime>
Apr 11 18:34:09 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:34:09 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:34:09 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:34:09 user nova-compute[82009]:       <nova:owner>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:user uuid="fde784625fda4447afc0b8e9bd0983a3">tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member</nova:user>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:project uuid="62a254c432f54e1b8735e40af7063506">tempest-ServerBootFromVolumeStableRescueTest-1689319261</nova:project>
Apr 11 18:34:09 user nova-compute[82009]:       </nova:owner>
Apr 11 18:34:09 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:34:09 user nova-compute[82009]:       <nova:ports>
Apr 11 18:34:09 user nova-compute[82009]:         <nova:port uuid="3d45cf5a-175a-4bca-9c73-119f3456643a">
Apr 11 18:34:09 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 18:34:09 user nova-compute[82009]:         </nova:port>
Apr 11 18:34:09 user nova-compute[82009]:       </nova:ports>
Apr 11 18:34:09 user nova-compute[82009]:     </nova:instance>
Apr 11 18:34:09 user nova-compute[82009]:   </metadata>
Apr 11 18:34:09 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:34:09 user nova-compute[82009]:     <system>
Apr 11 18:34:09 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:34:09 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:34:09 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:34:09 user nova-compute[82009]:       <entry name="serial">13a5f428-afe3-495a-80f5-b72b494a064a</entry>
Apr 11 18:34:09 user nova-compute[82009]:       <entry name="uuid">13a5f428-afe3-495a-80f5-b72b494a064a</entry>
Apr 11 18:34:09 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:34:09 user nova-compute[82009]:     </system>
Apr 11 18:34:09 user nova-compute[82009]:   </sysinfo>
Apr 11 18:34:09 user nova-compute[82009]:   <os>
Apr 11 18:34:09 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:34:09 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:34:09 user nova-compute[82009]:   </os>
Apr 11 18:34:09 user nova-compute[82009]:   <features>
Apr 11 18:34:09 user nova-compute[82009]:     <acpi/>
Apr 11 18:34:09 user nova-compute[82009]:     <apic/>
Apr 11 18:34:09 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:34:09 user nova-compute[82009]:   </features>
Apr 11 18:34:09 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:34:09 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:34:09 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:34:09 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:34:09 user nova-compute[82009]:   </clock>
Apr 11 18:34:09 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:34:09 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:34:09 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:34:09 user nova-compute[82009]:   </cpu>
Apr 11 18:34:09 user nova-compute[82009]:   <devices>
Apr 11 18:34:09 user nova-compute[82009]:     <disk type="block" device="disk">
Apr 11 18:34:09 user nova-compute[82009]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:34:09 user nova-compute[82009]:       <source dev="/dev/sdf"/>
Apr 11 18:34:09 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:34:09 user nova-compute[82009]:       <serial>e0eeb9b5-c668-49a8-9e24-7452295c3da9</serial>
Apr 11 18:34:09 user nova-compute[82009]:     </disk>
Apr 11 18:34:09 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:34:09 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:34:09 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue"/>
Apr 11 18:34:09 user nova-compute[82009]:       <target dev="vdb" bus="virtio"/>
Apr 11 18:34:09 user nova-compute[82009]:       <boot order="1"/>
Apr 11 18:34:09 user nova-compute[82009]:     </disk>
Apr 11 18:34:09 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:34:09 user nova-compute[82009]:       <mac address="fa:16:3e:db:18:61"/>
Apr 11 18:34:09 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:34:09 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:34:09 user nova-compute[82009]:       <target dev="tap3d45cf5a-17"/>
Apr 11 18:34:09 user nova-compute[82009]:     </interface>
Apr 11 18:34:09 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:34:09 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/console.log" append="off"/>
Apr 11 18:34:09 user nova-compute[82009]:     </serial>
Apr 11 18:34:09 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:34:09 user nova-compute[82009]:     <video>
Apr 11 18:34:09 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:34:09 user nova-compute[82009]:     </video>
Apr 11 18:34:09 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:34:09 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:34:09 user nova-compute[82009]:     </rng>
Apr 11 18:34:09 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:34:09 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:34:09 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:34:09 user nova-compute[82009]:     </memballoon>
Apr 11 18:34:09 user nova-compute[82009]:   </devices>
Apr 11 18:34:09 user nova-compute[82009]: </domain>
Apr 11 18:34:09 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:34:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance destroyed successfully.
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:34:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] No VIF found with MAC fa:16:3e:db:18:61, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:34:10 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:11 user nova-compute[82009]: WARNING nova.compute.manager [req-a6a1c929-71b2-4174-9cf2-c83a09d0ec07 req-aae5c9ae-bd1d-4cdf-8e6d-23bc63b8d618 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:34:11 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:34:12 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238037.4622443, b2175ccc-960d-4eca-8e41-3783cf28410b => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:34:12 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] VM Stopped (Lifecycle Event)
Apr 11 18:34:12 user nova-compute[82009]: DEBUG nova.compute.manager [None req-1c1ba7e0-9fd6-4239-a6a9-a08301d72b75 None None] [instance: b2175ccc-960d-4eca-8e41-3783cf28410b] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:34:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:13 user nova-compute[82009]: WARNING nova.compute.manager [req-ffe5a3d9-cd2f-4eb9-b51d-e6cdd107bea7 req-fff77dda-2589-4af6-bed7-c783e6af23ba service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state rescuing.
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 13a5f428-afe3-495a-80f5-b72b494a064a due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238053.4339492, 13a5f428-afe3-495a-80f5-b72b494a064a => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:34:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Resumed (Lifecycle Event)
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-31c893d1-d37f-4518-bca4-9b3d1d505d18 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:34:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238053.4355464, 13a5f428-afe3-495a-80f5-b72b494a064a => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:34:13 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Started (Lifecycle Event)
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:34:13 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:34:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:34:14 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:34:14 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8298MB free_disk=26.160133361816406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance fbf10cce-a01c-4e3f-8212-a2a0d42713df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 13a5f428-afe3-495a-80f5-b72b494a064a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 73e532c0-b6d3-49c5-8ee2-371d1423abda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:34:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:34:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:46 user nova-compute[82009]: INFO nova.compute.manager [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Terminating instance
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-vif-unplugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] No waiting events found dispatching network-vif-unplugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-589f19bc-a460-463c-9ad8-7a65d7f0207e req-549c3a02-026c-4306-ac52-c185ceed1e71 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-vif-unplugged-4c35126a-2ca0-4982-864d-7006fbc34a4d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:34:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Instance destroyed successfully.
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'resources' on Instance uuid fbf10cce-a01c-4e3f-8212-a2a0d42713df {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1018724989',display_name='tempest-AttachVolumeNegativeTest-server-1018724989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1018724989',id=37,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs3E53rMZKipajWGRqQNLsyHSKcE1Cs3luZCWsL04LhnfSC2/CNpZVWRwyQLpg30e3tVrpCk5563xjYj4TS9PlR6KzO1JX6F3Xn3TwcxmVfPqms9QO0aJW9BV6zucfu+g==',key_name='tempest-keypair-1464858302',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-o1dmznv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=fbf10cce-a01c-4e3f-8212-a2a0d42713df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "address": "fa:16:3e:de:d7:d8", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c35126a-2c", "ovs_interfaceid": "4c35126a-2ca0-4982-864d-7006fbc34a4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG os_vif [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c35126a-2c, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:34:46 user nova-compute[82009]: INFO os_vif [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:d8,bridge_name='br-int',has_traffic_filtering=True,id=4c35126a-2ca0-4982-864d-7006fbc34a4d,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c35126a-2c')
Apr 11 18:34:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Deleting instance files /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df_del
Apr 11 18:34:46 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Deletion of /opt/stack/data/nova/instances/fbf10cce-a01c-4e3f-8212-a2a0d42713df_del complete
Apr 11 18:34:47 user nova-compute[82009]: INFO nova.compute.manager [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 18:34:47 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:34:47 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:34:47 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:34:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:47 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:34:47 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Took 0.94 seconds to deallocate network for instance.
Apr 11 18:34:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-0a4493e6-6263-490e-b62d-be6a6bed882c req-031b1a06-8e11-4efd-b592-633300379b93 service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-vif-deleted-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:48 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Deleted allocations for instance fbf10cce-a01c-4e3f-8212-a2a0d42713df
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ca9eb675-fa16-4ff4-b6ae-3552323a5f9f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received event network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Acquiring lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] Lock "fbf10cce-a01c-4e3f-8212-a2a0d42713df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:34:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] No waiting events found dispatching network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:34:48 user nova-compute[82009]: WARNING nova.compute.manager [req-aaa9a29a-a2ca-4da2-9568-2cf838da739f req-a17cdc51-be82-4cf0-953e-f227dc97ec5c service nova] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Received unexpected event network-vif-plugged-4c35126a-2ca0-4982-864d-7006fbc34a4d for instance with vm_state deleted and task_state None.
Apr 11 18:34:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:34:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:01 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238086.9565513, fbf10cce-a01c-4e3f-8212-a2a0d42713df => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:35:01 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] VM Stopped (Lifecycle Event)
Apr 11 18:35:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-339263da-e4cd-4148-a58c-7fb9ba7e5e1c None None] [instance: fbf10cce-a01c-4e3f-8212-a2a0d42713df] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:35:03 user nova-compute[82009]: INFO nova.compute.claims [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Claim successful on node user
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:35:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.policy [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:35:03 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Creating image(s)
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "/opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "/opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "/opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk 1073741824" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:03 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Cannot resize image /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lazy-loading 'migration_context' on Instance uuid f692dcf6-6347-40f3-9e6a-cff075a18370 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Successfully created port: 4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Ensure instance console log exists: /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Successfully updated port: 4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquired lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-changed-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.compute.manager [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Refreshing instance network info cache due to event network-changed-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Acquiring lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updating instance_info_cache with network_info: [{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Releasing lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Instance network_info: |[{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Acquired lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.neutron [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Refreshing network info cache for port 4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Start _get_guest_xml network_info=[{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:35:05 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:35:05 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1438556823',display_name='tempest-ServersNegativeTestJSON-server-1438556823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1438556823',id=43,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='423994357c024575acae85fb885f4069',ramdisk_id='',reservation_id='r-u4tmv6g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1378388549',owner_user_name='tempest-ServersNegativeTestJSON-1378388549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:35:04Z,user_data=None,user_id='423f3e46d47448fb880c9eeb1281565a',uuid=f692dcf6-6347-40f3-9e6a-cff075a18370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converting VIF {"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lazy-loading 'pci_devices' on Instance uuid f692dcf6-6347-40f3-9e6a-cff075a18370 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:35:05 user nova-compute[82009]:   <uuid>f692dcf6-6347-40f3-9e6a-cff075a18370</uuid>
Apr 11 18:35:05 user nova-compute[82009]:   <name>instance-0000002b</name>
Apr 11 18:35:05 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:35:05 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:35:05 user nova-compute[82009]:   <metadata>
Apr 11 18:35:05 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:35:05 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:35:05 user nova-compute[82009]:       <nova:name>tempest-ServersNegativeTestJSON-server-1438556823</nova:name>
Apr 11 18:35:05 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:35:05</nova:creationTime>
Apr 11 18:35:05 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:35:05 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:35:05 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:35:05 user nova-compute[82009]:       <nova:owner>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:user uuid="423f3e46d47448fb880c9eeb1281565a">tempest-ServersNegativeTestJSON-1378388549-project-member</nova:user>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:project uuid="423994357c024575acae85fb885f4069">tempest-ServersNegativeTestJSON-1378388549</nova:project>
Apr 11 18:35:05 user nova-compute[82009]:       </nova:owner>
Apr 11 18:35:05 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:35:05 user nova-compute[82009]:       <nova:ports>
Apr 11 18:35:05 user nova-compute[82009]:         <nova:port uuid="4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d">
Apr 11 18:35:05 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 18:35:05 user nova-compute[82009]:         </nova:port>
Apr 11 18:35:05 user nova-compute[82009]:       </nova:ports>
Apr 11 18:35:05 user nova-compute[82009]:     </nova:instance>
Apr 11 18:35:05 user nova-compute[82009]:   </metadata>
Apr 11 18:35:05 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:35:05 user nova-compute[82009]:     <system>
Apr 11 18:35:05 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:35:05 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:35:05 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:35:05 user nova-compute[82009]:       <entry name="serial">f692dcf6-6347-40f3-9e6a-cff075a18370</entry>
Apr 11 18:35:05 user nova-compute[82009]:       <entry name="uuid">f692dcf6-6347-40f3-9e6a-cff075a18370</entry>
Apr 11 18:35:05 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:35:05 user nova-compute[82009]:     </system>
Apr 11 18:35:05 user nova-compute[82009]:   </sysinfo>
Apr 11 18:35:05 user nova-compute[82009]:   <os>
Apr 11 18:35:05 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:35:05 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:35:05 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:35:05 user nova-compute[82009]:   </os>
Apr 11 18:35:05 user nova-compute[82009]:   <features>
Apr 11 18:35:05 user nova-compute[82009]:     <acpi/>
Apr 11 18:35:05 user nova-compute[82009]:     <apic/>
Apr 11 18:35:05 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:35:05 user nova-compute[82009]:   </features>
Apr 11 18:35:05 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:35:05 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:35:05 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:35:05 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:35:05 user nova-compute[82009]:   </clock>
Apr 11 18:35:05 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:35:05 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:35:05 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:35:05 user nova-compute[82009]:   </cpu>
Apr 11 18:35:05 user nova-compute[82009]:   <devices>
Apr 11 18:35:05 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:35:05 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:35:05 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk"/>
Apr 11 18:35:05 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:35:05 user nova-compute[82009]:     </disk>
Apr 11 18:35:05 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:35:05 user nova-compute[82009]:       <mac address="fa:16:3e:a2:39:3a"/>
Apr 11 18:35:05 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:35:05 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:35:05 user nova-compute[82009]:       <target dev="tap4cb252fb-ad"/>
Apr 11 18:35:05 user nova-compute[82009]:     </interface>
Apr 11 18:35:05 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:35:05 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/console.log" append="off"/>
Apr 11 18:35:05 user nova-compute[82009]:     </serial>
Apr 11 18:35:05 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:35:05 user nova-compute[82009]:     <video>
Apr 11 18:35:05 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:35:05 user nova-compute[82009]:     </video>
Apr 11 18:35:05 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:35:05 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:35:05 user nova-compute[82009]:     </rng>
Apr 11 18:35:05 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:35:05 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:35:05 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:35:05 user nova-compute[82009]:     </memballoon>
Apr 11 18:35:05 user nova-compute[82009]:   </devices>
Apr 11 18:35:05 user nova-compute[82009]: </domain>
Apr 11 18:35:05 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1438556823',display_name='tempest-ServersNegativeTestJSON-server-1438556823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1438556823',id=43,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='423994357c024575acae85fb885f4069',ramdisk_id='',reservation_id='r-u4tmv6g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1378388549',owner_user_name='tempest-ServersNegativeTestJSON-1378388549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:35:04Z,user_data=None,user_id='423f3e46d47448fb880c9eeb1281565a',uuid=f692dcf6-6347-40f3-9e6a-cff075a18370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converting VIF {"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG os_vif [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cb252fb-ad, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cb252fb-ad, col_values=(('external_ids', {'iface-id': '4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:39:3a', 'vm-uuid': 'f692dcf6-6347-40f3-9e6a-cff075a18370'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:05 user nova-compute[82009]: INFO os_vif [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad')
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:35:05 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] No VIF found with MAC fa:16:3e:a2:39:3a, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:35:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updated VIF entry in instance network info cache for port 4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:35:06 user nova-compute[82009]: DEBUG nova.network.neutron [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updating instance_info_cache with network_info: [{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c78387bf-4d22-45e4-9063-d859db3ec9c1 req-9a3b4add-d82d-42f7-addf-ca09c07a9796 service nova] Releasing lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG nova.compute.manager [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:07 user nova-compute[82009]: WARNING nova.compute.manager [req-48e510c3-40bf-4d32-9696-0f587a6347ac req-ec124dab-5cbd-47ef-8ab0-d8a617d7c48c service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state building and task_state spawning.
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-changed-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Refreshing instance network info cache due to event network-changed-95038301-4dc6-4a03-ad63-c17301be86c7. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Acquiring lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Acquired lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Refreshing network info cache for port 95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238109.2674208, f692dcf6-6347-40f3-9e6a-cff075a18370 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] VM Resumed (Lifecycle Event)
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Instance spawned successfully.
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238109.276956, f692dcf6-6347-40f3-9e6a-cff075a18370 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] VM Started (Lifecycle Event)
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:09 user nova-compute[82009]: INFO nova.compute.manager [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Took 6.40 seconds to build instance.
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:09 user nova-compute[82009]: WARNING nova.compute.manager [req-491cb4eb-65a5-4ded-a38a-ccde0a33bf8b req-20c1846a-9420-41e7-996a-e12aa427843f service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state active and task_state None.
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c8f6f789-ddea-45bb-9d3d-f7f356c2f1e3 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.509s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updated VIF entry in instance network info cache for port 95038301-4dc6-4a03-ad63-c17301be86c7. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updating instance_info_cache with network_info: [{"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bf367b43-59b3-4b7a-8ab1-2be0d537b71e req-11ede816-3943-4266-b530-eb039515f3d5 service nova] Releasing lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-changed-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.compute.manager [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Refreshing instance network info cache due to event network-changed-95038301-4dc6-4a03-ad63-c17301be86c7. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Acquiring lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Acquired lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:09 user nova-compute[82009]: DEBUG nova.network.neutron [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Refreshing network info cache for port 95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:10 user nova-compute[82009]: INFO nova.compute.manager [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Terminating instance
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.compute.manager [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updated VIF entry in instance network info cache for port 95038301-4dc6-4a03-ad63-c17301be86c7. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.network.neutron [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updating instance_info_cache with network_info: [{"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-06512333-e695-40f9-8bc5-5fc103e16dab req-51c0e106-f3a0-4106-9d7a-657393a5b0e6 service nova] Releasing lock "refresh_cache-73e532c0-b6d3-49c5-8ee2-371d1423abda" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:10 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Instance destroyed successfully.
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.objects.instance [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'resources' on Instance uuid 73e532c0-b6d3-49c5-8ee2-371d1423abda {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1811728730',display_name='tempest-TestVolumeBootPattern-server-1811728730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1811728730',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-ivhluy8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:33:28Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=73e532c0-b6d3-49c5-8ee2-371d1423abda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "95038301-4dc6-4a03-ad63-c17301be86c7", "address": "fa:16:3e:ee:5c:7b", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95038301-4d", "ovs_interfaceid": "95038301-4dc6-4a03-ad63-c17301be86c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_vif [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95038301-4d, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:35:10 user nova-compute[82009]: INFO os_vif [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:5c:7b,bridge_name='br-int',has_traffic_filtering=True,id=95038301-4dc6-4a03-ad63-c17301be86c7,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95038301-4d')
Apr 11 18:35:10 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLjFbyXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:35:10 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed65d22-3912-4f22-aba1-7318fdd4d2a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:35:10 user nova-compute[82009]: No targets found.
Apr 11 18:35:10 user nova-compute[82009]: iSNS:
Apr 11 18:35:10 user nova-compute[82009]: No targets found.
Apr 11 18:35:10 user nova-compute[82009]: STATIC:
Apr 11 18:35:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:35:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:35:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:35:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:35:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:35:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:35:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56
Apr 11 18:35:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:35:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:35:10 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296
Apr 11 18:35:10 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:35:10 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:35:10 user nova-compute[82009]: FIRMWARE:
Apr 11 18:35:10 user nova-compute[82009]: No targets found.
Apr 11 18:35:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:35:10 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:35:10 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85fa194-ac1d-4aa6-a700-07aa33e90f02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad81217-ff07-40b9-ba22-5df4cef9b988]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 (non-flash)
Apr 11 18:35:10 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d8156440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc2fcf2-b1ac-4ec4-90ab-a32385244198]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0aae72-f2ce-4cf0-af2a-14e2ccd18fca]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5171ec0c-cd57-448e-a9ab-0da7393902b5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:35:10 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad4ced-b67f-4d77-a35b-4fc998be18d3]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[703b48d1-4be9-4217-911a-680d71147c35]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fe63d7-3bf0-4f9b-9a35-06f12ffc8918]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260]
Apr 11 18:35:11 user nova-compute[82009]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56, portal: 172.16.0.220,3260] successful.
Apr 11 18:35:11 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b95fd41-cafd-4f63-b6cc-ba35d89aac56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4c675-7c89-49bb-9e5b-faff55ab972b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== disconnect_volume: return (342ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:35:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Deleting instance files /opt/stack/data/nova/instances/73e532c0-b6d3-49c5-8ee2-371d1423abda_del
Apr 11 18:35:11 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Deletion of /opt/stack/data/nova/instances/73e532c0-b6d3-49c5-8ee2-371d1423abda_del complete
Apr 11 18:35:11 user nova-compute[82009]: INFO nova.compute.manager [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-vif-unplugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] No waiting events found dispatching network-vif-unplugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-vif-unplugged-95038301-4dc6-4a03-ad63-c17301be86c7 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Acquiring lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] No waiting events found dispatching network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:11 user nova-compute[82009]: WARNING nova.compute.manager [req-5f5077fd-7896-4d1b-9de7-fcff202a7e6e req-38ff6610-7f57-4c53-9883-2842b9e8400b service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received unexpected event network-vif-plugged-95038301-4dc6-4a03-ad63-c17301be86c7 for instance with vm_state active and task_state deleting.
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:11 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Took 0.51 seconds to deallocate network for instance.
Apr 11 18:35:11 user nova-compute[82009]: DEBUG nova.compute.manager [req-5c26baaf-d720-43b8-a4bf-08c71feca2b1 req-418ba8b7-49d0-425e-a134-45ae213fba96 service nova] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Received event network-vif-deleted-95038301-4dc6-4a03-ad63-c17301be86c7 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:12 user nova-compute[82009]: INFO nova.compute.manager [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Took 0.81 seconds to detach 1 volumes for instance.
Apr 11 18:35:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:12 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Deleted allocations for instance 73e532c0-b6d3-49c5-8ee2-371d1423abda
Apr 11 18:35:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:12 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:35:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-64fa3214-dafa-4c75-a40b-d407af28229d tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "73e532c0-b6d3-49c5-8ee2-371d1423abda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [{"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-bef10824-ced0-49d5-934a-c509ab119cbf" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:14 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:35:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:35:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8228MB free_disk=26.176578521728516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 13a5f428-afe3-495a-80f5-b72b494a064a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:35:16 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:35:17 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:35:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:35:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:35:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:25 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238110.7635067, 73e532c0-b6d3-49c5-8ee2-371d1423abda => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:35:25 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] VM Stopped (Lifecycle Event)
Apr 11 18:35:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-871f0555-307c-41f7-9fdb-7f4e2b13485c None None] [instance: 73e532c0-b6d3-49c5-8ee2-371d1423abda] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:39 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:35:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:39 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:35:39 user nova-compute[82009]: INFO nova.compute.claims [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Claim successful on node user
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:35:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:35:40 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Creating image(s)
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.policy [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk 1073741824" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:35:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Cannot resize image /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'migration_context' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Ensure instance console log exists: /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Successfully created port: c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:35:41 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Successfully updated port: c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquired lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-changed-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Refreshing instance network info cache due to event network-changed-c667caf2-9e07-4a9e-a45f-d5f10898124a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Acquiring lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.neutron [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updating instance_info_cache with network_info: [{"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Releasing lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Instance network_info: |[{"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Acquired lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Refreshing network info cache for port c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Start _get_guest_xml network_info=[{"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:35:42 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:35:42 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-328545184',display_name='tempest-AttachVolumeNegativeTest-server-328545184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-328545184',id=44,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3IjFSFuUivBNpfQF2rtSYTbcXASfl6aabS3bgmO/p7n8BH94qlrQ3XnifiKs1PEA2gzpUr4NAP6XOtmsOqapxYUVA4fW/2Q1ESbSxPS1dDRrkl21GGjOby2LesnRQWgA==',key_name='tempest-keypair-2138755154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-ez7073mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=9a1efd21-1752-4335-841a-3669ac667247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:35:42 user nova-compute[82009]:   <uuid>9a1efd21-1752-4335-841a-3669ac667247</uuid>
Apr 11 18:35:42 user nova-compute[82009]:   <name>instance-0000002c</name>
Apr 11 18:35:42 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:35:42 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:35:42 user nova-compute[82009]:   <metadata>
Apr 11 18:35:42 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:35:42 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:35:42 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeNegativeTest-server-328545184</nova:name>
Apr 11 18:35:42 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:35:42</nova:creationTime>
Apr 11 18:35:42 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:35:42 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:35:42 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:35:42 user nova-compute[82009]:       <nova:owner>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:user uuid="b91adf882c384c8c9e27a24a8c55b0a1">tempest-AttachVolumeNegativeTest-1806714760-project-member</nova:user>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:project uuid="a92ba4ae3f244cfc9f3f0732ab9cc649">tempest-AttachVolumeNegativeTest-1806714760</nova:project>
Apr 11 18:35:42 user nova-compute[82009]:       </nova:owner>
Apr 11 18:35:42 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:35:42 user nova-compute[82009]:       <nova:ports>
Apr 11 18:35:42 user nova-compute[82009]:         <nova:port uuid="c667caf2-9e07-4a9e-a45f-d5f10898124a">
Apr 11 18:35:42 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 18:35:42 user nova-compute[82009]:         </nova:port>
Apr 11 18:35:42 user nova-compute[82009]:       </nova:ports>
Apr 11 18:35:42 user nova-compute[82009]:     </nova:instance>
Apr 11 18:35:42 user nova-compute[82009]:   </metadata>
Apr 11 18:35:42 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:35:42 user nova-compute[82009]:     <system>
Apr 11 18:35:42 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:35:42 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:35:42 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:35:42 user nova-compute[82009]:       <entry name="serial">9a1efd21-1752-4335-841a-3669ac667247</entry>
Apr 11 18:35:42 user nova-compute[82009]:       <entry name="uuid">9a1efd21-1752-4335-841a-3669ac667247</entry>
Apr 11 18:35:42 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:35:42 user nova-compute[82009]:     </system>
Apr 11 18:35:42 user nova-compute[82009]:   </sysinfo>
Apr 11 18:35:42 user nova-compute[82009]:   <os>
Apr 11 18:35:42 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:35:42 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:35:42 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:35:42 user nova-compute[82009]:   </os>
Apr 11 18:35:42 user nova-compute[82009]:   <features>
Apr 11 18:35:42 user nova-compute[82009]:     <acpi/>
Apr 11 18:35:42 user nova-compute[82009]:     <apic/>
Apr 11 18:35:42 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:35:42 user nova-compute[82009]:   </features>
Apr 11 18:35:42 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:35:42 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:35:42 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:35:42 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:35:42 user nova-compute[82009]:   </clock>
Apr 11 18:35:42 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:35:42 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:35:42 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:35:42 user nova-compute[82009]:   </cpu>
Apr 11 18:35:42 user nova-compute[82009]:   <devices>
Apr 11 18:35:42 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:35:42 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:35:42 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk"/>
Apr 11 18:35:42 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:35:42 user nova-compute[82009]:     </disk>
Apr 11 18:35:42 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:35:42 user nova-compute[82009]:       <mac address="fa:16:3e:81:96:81"/>
Apr 11 18:35:42 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:35:42 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:35:42 user nova-compute[82009]:       <target dev="tapc667caf2-9e"/>
Apr 11 18:35:42 user nova-compute[82009]:     </interface>
Apr 11 18:35:42 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:35:42 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/console.log" append="off"/>
Apr 11 18:35:42 user nova-compute[82009]:     </serial>
Apr 11 18:35:42 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:35:42 user nova-compute[82009]:     <video>
Apr 11 18:35:42 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:35:42 user nova-compute[82009]:     </video>
Apr 11 18:35:42 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:35:42 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:35:42 user nova-compute[82009]:     </rng>
Apr 11 18:35:42 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:35:42 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:35:42 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:35:42 user nova-compute[82009]:     </memballoon>
Apr 11 18:35:42 user nova-compute[82009]:   </devices>
Apr 11 18:35:42 user nova-compute[82009]: </domain>
Apr 11 18:35:42 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-328545184',display_name='tempest-AttachVolumeNegativeTest-server-328545184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-328545184',id=44,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3IjFSFuUivBNpfQF2rtSYTbcXASfl6aabS3bgmO/p7n8BH94qlrQ3XnifiKs1PEA2gzpUr4NAP6XOtmsOqapxYUVA4fW/2Q1ESbSxPS1dDRrkl21GGjOby2LesnRQWgA==',key_name='tempest-keypair-2138755154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-ez7073mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=9a1efd21-1752-4335-841a-3669ac667247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG os_vif [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc667caf2-9e, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc667caf2-9e, col_values=(('external_ids', {'iface-id': 'c667caf2-9e07-4a9e-a45f-d5f10898124a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:96:81', 'vm-uuid': '9a1efd21-1752-4335-841a-3669ac667247'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:42 user nova-compute[82009]: INFO os_vif [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e')
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:81:96:81, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updated VIF entry in instance network info cache for port c667caf2-9e07-4a9e-a45f-d5f10898124a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG nova.network.neutron [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updating instance_info_cache with network_info: [{"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c14c7860-84eb-4979-a8b0-f94f5a7d8ff7 req-4138495e-f478-487a-96f0-4ae7efcbf768 service nova] Releasing lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] No waiting events found dispatching network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:44 user nova-compute[82009]: WARNING nova.compute.manager [req-39224290-d99d-4291-b81c-940a89d6a148 req-d581eeeb-055e-433c-929e-5be31c8687cb service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received unexpected event network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a for instance with vm_state building and task_state spawning.
Apr 11 18:35:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238145.8914077, 9a1efd21-1752-4335-841a-3669ac667247 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:35:45 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] VM Resumed (Lifecycle Event)
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:35:45 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Instance spawned successfully.
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:35:45 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238145.8928401, 9a1efd21-1752-4335-841a-3669ac667247 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:35:45 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] VM Started (Lifecycle Event)
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:35:45 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:35:45 user nova-compute[82009]: INFO nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 11 18:35:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:35:46 user nova-compute[82009]: INFO nova.compute.manager [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Took 6.22 seconds to build instance.
Apr 11 18:35:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7b7e307d-fb7c-41cd-b698-3d6036c437f7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.308s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] No waiting events found dispatching network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:46 user nova-compute[82009]: WARNING nova.compute.manager [req-0115f78b-b5e8-4c11-b4bd-e688dc2f405d req-73c30998-ef55-41cd-a61b-ede59bf4785c service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received unexpected event network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a for instance with vm_state active and task_state None.
Apr 11 18:35:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:57 user nova-compute[82009]: INFO nova.compute.manager [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Unrescuing
Apr 11 18:35:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquired lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Releasing lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'flavor' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:57 user nova-compute[82009]: WARNING nova.compute.manager [req-773cca2e-7b2b-400b-96dd-2ad6792e0cf5 req-5162fb9f-d92a-4a83-bd81-69e3aabaa0a1 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:35:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance destroyed successfully.
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:59 user nova-compute[82009]: WARNING nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:59 user nova-compute[82009]: WARNING nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:59 user nova-compute[82009]: WARNING nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:59 user nova-compute[82009]: WARNING nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:59 user nova-compute[82009]: WARNING nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:35:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:35:59 user nova-compute[82009]: WARNING nova.compute.manager [req-6bb01666-a252-4cc2-9a36-24ccb7ea7662 req-62c5770e-ca1b-4e1e-a4ca-f1e07668b521 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state rescued and task_state unrescuing.
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.host [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Removed pending event for 13a5f428-afe3-495a-80f5-b72b494a064a due to event {{(pid=82009) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238161.8427775, 13a5f428-afe3-495a-80f5-b72b494a064a => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:36:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Resumed (Lifecycle Event)
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e0fd3456-59ed-4ab7-8696-d039fa0264a5 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:36:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238161.8442614, 13a5f428-afe3-495a-80f5-b72b494a064a => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:36:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Started (Lifecycle Event)
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:36:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:36:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:02 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:02 user nova-compute[82009]: DEBUG nova.compute.manager [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:36:02 user nova-compute[82009]: WARNING nova.compute.manager [req-7075ebad-9cfc-4033-9296-2b0aa986814a req-d1b6664a-477f-4983-a2c9-d4796cacfe37 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state None.
Apr 11 18:36:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-changed-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG nova.compute.manager [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Refreshing instance network info cache due to event network-changed-15811309-acaa-4e5f-8b93-0f4511612c79. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Acquiring lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Acquired lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG nova.network.neutron [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Refreshing network info cache for port 15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:03 user nova-compute[82009]: INFO nova.compute.manager [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Terminating instance
Apr 11 18:36:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-vif-unplugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] No waiting events found dispatching network-vif-unplugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.compute.manager [req-affa4199-d76a-4bd9-bfc8-7fddf010a0db req-77709548-c406-4940-9352-ecdf17a1c28a service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-vif-unplugged-15811309-acaa-4e5f-8b93-0f4511612c79 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:36:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Instance destroyed successfully.
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.objects.instance [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lazy-loading 'resources' on Instance uuid 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-416829470',display_name='tempest-TestVolumeBootPattern-server-416829470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-416829470',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Usy4g+vkBKtgkeN/9jFVPAVjN3djwZ8c2oYsj3xB6XbQSwjWZ0ZNgf2NpKvXMSckOnf+qvAnZB7Z1HAtXUdDL+ZE24RLwXiDm/I0qc90Mb1YrH83E9gj6OdrYF6uAhg==',key_name='tempest-TestVolumeBootPattern-1952119330',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f6857b777f4207b93d8c28aa39054b',ramdisk_id='',reservation_id='r-c1xg8z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1768143130',owner_user_name='tempest-TestVolumeBootPattern-1768143130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:31:32Z,user_data=None,user_id='4c8825bcd5894c999412499de320dc00',uuid=91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converting VIF {"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_vif [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15811309-ac, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:36:04 user nova-compute[82009]: INFO os_vif [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:03:57,bridge_name='br-int',has_traffic_filtering=True,id=15811309-acaa-4e5f-8b93-0f4511612c79,network=Network(b52e5445-d18f-4394-a52e-5927662174c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15811309-ac')
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URKwAkNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:36:04 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updated VIF entry in instance network info cache for port 15811309-acaa-4e5f-8b93-0f4511612c79. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.network.neutron [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updating instance_info_cache with network_info: [{"id": "15811309-acaa-4e5f-8b93-0f4511612c79", "address": "fa:16:3e:b3:03:57", "network": {"id": "b52e5445-d18f-4394-a52e-5927662174c0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1133462227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f6857b777f4207b93d8c28aa39054b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15811309-ac", "ovs_interfaceid": "15811309-acaa-4e5f-8b93-0f4511612c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd0204c-63c1-4b50-896b-f34718589d1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:36:04 user nova-compute[82009]: No targets found.
Apr 11 18:36:04 user nova-compute[82009]: iSNS:
Apr 11 18:36:04 user nova-compute[82009]: No targets found.
Apr 11 18:36:04 user nova-compute[82009]: STATIC:
Apr 11 18:36:04 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:36:04 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:36:04 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:36:04 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:36:04 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:36:04 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:36:04 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296
Apr 11 18:36:04 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:36:04 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:36:04 user nova-compute[82009]: FIRMWARE:
Apr 11 18:36:04 user nova-compute[82009]: No targets found.
Apr 11 18:36:04 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:36:04 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:36:04 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-d1dce72a-68ac-4a78-94a5-0d42d4868e21 req-e57450a7-1891-452c-8b0b-cc2799b8820b service nova] Releasing lock "refresh_cache-91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda73c61-7920-469b-830c-7b502792d094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d80e43c-2987-4745-974e-61c6056790fd]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:36:04 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:36:04 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:36:04 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:36:04 user nova-compute[82009]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 (non-flash)
Apr 11 18:36:04 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:36:04 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6cb0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296'): ({'sde'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Removing single pathed devices sde {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eb10bd-c95e-4423-b301-47fff3b6349e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8999bd-2ab6-489e-96b4-efeca0f67ff4]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Flushing IO for device /dev/sde {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e657e24-04ba-43d4-a3fa-2ead101267c5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c8f2af-cf53-44af-944e-56fd16ec9f47]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] SCSI volumes sde have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fe1ce362', '/dev/disk/by-id/scsi-1SCST_BIOfe1ce362-211b111f4bb25d0f', '/dev/disk/by-id/scsi-23231316231313166') {{(pid=92248) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299b8a5-a985-49b3-99ef-f251c8e67bff]: (4, None) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f218e3-71d9-43ed-baaa-fce57017f68a]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b90912-7070-485f-a688-757139861638]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260]
Apr 11 18:36:04 user nova-compute[82009]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296, portal: 172.16.0.220,3260] successful.
Apr 11 18:36:04 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6709e067-9e56-479d-9981-a93cbfbf9296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6d3de5-6e7f-4327-8e24-e8b1a7bf123e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] <== disconnect_volume: return (350ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:36:04 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:36:04 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Deleting instance files /opt/stack/data/nova/instances/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1_del
Apr 11 18:36:05 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Deletion of /opt/stack/data/nova/instances/91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1_del complete
Apr 11 18:36:05 user nova-compute[82009]: INFO nova.compute.manager [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 11 18:36:05 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:36:05 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:36:05 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:36:05 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:36:05 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Took 0.52 seconds to deallocate network for instance.
Apr 11 18:36:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Acquiring lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] No waiting events found dispatching network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:36:06 user nova-compute[82009]: WARNING nova.compute.manager [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received unexpected event network-vif-plugged-15811309-acaa-4e5f-8b93-0f4511612c79 for instance with vm_state active and task_state deleting.
Apr 11 18:36:06 user nova-compute[82009]: DEBUG nova.compute.manager [req-bda463ef-d75b-41f0-8853-f22c6fa10c53 req-70e80bf9-13a0-49ec-a0d5-1ee05b8aa7ee service nova] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Received event network-vif-deleted-15811309-acaa-4e5f-8b93-0f4511612c79 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:06 user nova-compute[82009]: INFO nova.compute.manager [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Took 0.84 seconds to detach 1 volumes for instance.
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:06 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Deleted allocations for instance 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1
Apr 11 18:36:06 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-d6788135-2ee8-4d6f-9e85-cd4eb2898080 tempest-TestVolumeBootPattern-1768143130 tempest-TestVolumeBootPattern-1768143130-project-member] Lock "91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.009s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:09 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:36:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:36:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:36:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Updating instance_info_cache with network_info: [{"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-91053286-2092-4540-a527-564c0cf78bd3" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:14 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:15 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:36:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:36:16 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8187MB free_disk=26.126567840576172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 13a5f428-afe3-495a-80f5-b72b494a064a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9a1efd21-1752-4335-841a-3669ac667247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:36:16 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:36:17 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:36:17 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:36:17 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:36:17 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:36:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238164.5881267, 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:36:19 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] VM Stopped (Lifecycle Event)
Apr 11 18:36:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-da1ba90f-58f7-49a4-8863-658696c8cc26 None None] [instance: 91d7549e-30b1-44b8-bdfa-9ea18bbbbdf1] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:36:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:36:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:24 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:36:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:33 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:36:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:36:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:36:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:36:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:36:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_power_states {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 91053286-2092-4540-a527-564c0cf78bd3 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid f692dcf6-6347-40f3-9e6a-cff075a18370 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "91053286-2092-4540-a527-564c0cf78bd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "13a5f428-afe3-495a-80f5-b72b494a064a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "9a1efd21-1752-4335-841a-3669ac667247" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "13a5f428-afe3-495a-80f5-b72b494a064a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "9a1efd21-1752-4335-841a-3669ac667247" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "91053286-2092-4540-a527-564c0cf78bd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:54 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:36:54 user nova-compute[82009]: INFO nova.compute.claims [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Claim successful on node user
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:36:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.policy [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '423f3e46d47448fb880c9eeb1281565a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423994357c024575acae85fb885f4069', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:36:55 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Creating image(s)
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "/opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "/opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "/opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk 1073741824" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.146s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:36:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Cannot resize image /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lazy-loading 'migration_context' on Instance uuid 73cbcd59-6e6a-4950-8dae-738f3b7151ac {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Ensure instance console log exists: /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Successfully created port: 223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:36:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Successfully updated port: 223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "refresh_cache-73cbcd59-6e6a-4950-8dae-738f3b7151ac" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquired lock "refresh_cache-73cbcd59-6e6a-4950-8dae-738f3b7151ac" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-changed-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Refreshing instance network info cache due to event network-changed-223b0c54-2078-474a-96f4-91346bd1c1ff. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Acquiring lock "refresh_cache-73cbcd59-6e6a-4950-8dae-738f3b7151ac" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.neutron [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Updating instance_info_cache with network_info: [{"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Releasing lock "refresh_cache-73cbcd59-6e6a-4950-8dae-738f3b7151ac" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Instance network_info: |[{"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Acquired lock "refresh_cache-73cbcd59-6e6a-4950-8dae-738f3b7151ac" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.neutron [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Refreshing network info cache for port 223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Start _get_guest_xml network_info=[{"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:36:57 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:36:57 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-508320532',display_name='tempest-ServersNegativeTestJSON-server-508320532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-508320532',id=45,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='423994357c024575acae85fb885f4069',ramdisk_id='',reservation_id='r-969kupzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1378388549',owner_user_name='tempest-ServersNegativeTestJSON-1378388549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:36:55Z,user_data=None,user_id='423f3e46d47448fb880c9eeb1281565a',uuid=73cbcd59-6e6a-4950-8dae-738f3b7151ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converting VIF {"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.objects.instance [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lazy-loading 'pci_devices' on Instance uuid 73cbcd59-6e6a-4950-8dae-738f3b7151ac {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:36:57 user nova-compute[82009]:   <uuid>73cbcd59-6e6a-4950-8dae-738f3b7151ac</uuid>
Apr 11 18:36:57 user nova-compute[82009]:   <name>instance-0000002d</name>
Apr 11 18:36:57 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:36:57 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:36:57 user nova-compute[82009]:   <metadata>
Apr 11 18:36:57 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:36:57 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:36:57 user nova-compute[82009]:       <nova:name>tempest-ServersNegativeTestJSON-server-508320532</nova:name>
Apr 11 18:36:57 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:36:57</nova:creationTime>
Apr 11 18:36:57 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:36:57 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:36:57 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:36:57 user nova-compute[82009]:       <nova:owner>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:user uuid="423f3e46d47448fb880c9eeb1281565a">tempest-ServersNegativeTestJSON-1378388549-project-member</nova:user>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:project uuid="423994357c024575acae85fb885f4069">tempest-ServersNegativeTestJSON-1378388549</nova:project>
Apr 11 18:36:57 user nova-compute[82009]:       </nova:owner>
Apr 11 18:36:57 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:36:57 user nova-compute[82009]:       <nova:ports>
Apr 11 18:36:57 user nova-compute[82009]:         <nova:port uuid="223b0c54-2078-474a-96f4-91346bd1c1ff">
Apr 11 18:36:57 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 18:36:57 user nova-compute[82009]:         </nova:port>
Apr 11 18:36:57 user nova-compute[82009]:       </nova:ports>
Apr 11 18:36:57 user nova-compute[82009]:     </nova:instance>
Apr 11 18:36:57 user nova-compute[82009]:   </metadata>
Apr 11 18:36:57 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:36:57 user nova-compute[82009]:     <system>
Apr 11 18:36:57 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:36:57 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:36:57 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:36:57 user nova-compute[82009]:       <entry name="serial">73cbcd59-6e6a-4950-8dae-738f3b7151ac</entry>
Apr 11 18:36:57 user nova-compute[82009]:       <entry name="uuid">73cbcd59-6e6a-4950-8dae-738f3b7151ac</entry>
Apr 11 18:36:57 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:36:57 user nova-compute[82009]:     </system>
Apr 11 18:36:57 user nova-compute[82009]:   </sysinfo>
Apr 11 18:36:57 user nova-compute[82009]:   <os>
Apr 11 18:36:57 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:36:57 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:36:57 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:36:57 user nova-compute[82009]:   </os>
Apr 11 18:36:57 user nova-compute[82009]:   <features>
Apr 11 18:36:57 user nova-compute[82009]:     <acpi/>
Apr 11 18:36:57 user nova-compute[82009]:     <apic/>
Apr 11 18:36:57 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:36:57 user nova-compute[82009]:   </features>
Apr 11 18:36:57 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:36:57 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:36:57 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:36:57 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:36:57 user nova-compute[82009]:   </clock>
Apr 11 18:36:57 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:36:57 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:36:57 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:36:57 user nova-compute[82009]:   </cpu>
Apr 11 18:36:57 user nova-compute[82009]:   <devices>
Apr 11 18:36:57 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:36:57 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:36:57 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk"/>
Apr 11 18:36:57 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:36:57 user nova-compute[82009]:     </disk>
Apr 11 18:36:57 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:36:57 user nova-compute[82009]:       <mac address="fa:16:3e:16:63:ee"/>
Apr 11 18:36:57 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:36:57 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:36:57 user nova-compute[82009]:       <target dev="tap223b0c54-20"/>
Apr 11 18:36:57 user nova-compute[82009]:     </interface>
Apr 11 18:36:57 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:36:57 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/console.log" append="off"/>
Apr 11 18:36:57 user nova-compute[82009]:     </serial>
Apr 11 18:36:57 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:36:57 user nova-compute[82009]:     <video>
Apr 11 18:36:57 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:36:57 user nova-compute[82009]:     </video>
Apr 11 18:36:57 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:36:57 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:36:57 user nova-compute[82009]:     </rng>
Apr 11 18:36:57 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:36:57 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:36:57 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:36:57 user nova-compute[82009]:     </memballoon>
Apr 11 18:36:57 user nova-compute[82009]:   </devices>
Apr 11 18:36:57 user nova-compute[82009]: </domain>
Apr 11 18:36:57 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-508320532',display_name='tempest-ServersNegativeTestJSON-server-508320532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-508320532',id=45,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='423994357c024575acae85fb885f4069',ramdisk_id='',reservation_id='r-969kupzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1378388549',owner_user_name='tempest-ServersNegativeTestJSON-1378388549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:36:55Z,user_data=None,user_id='423f3e46d47448fb880c9eeb1281565a',uuid=73cbcd59-6e6a-4950-8dae-738f3b7151ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converting VIF {"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG os_vif [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap223b0c54-20, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap223b0c54-20, col_values=(('external_ids', {'iface-id': '223b0c54-2078-474a-96f4-91346bd1c1ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:63:ee', 'vm-uuid': '73cbcd59-6e6a-4950-8dae-738f3b7151ac'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:57 user nova-compute[82009]: INFO os_vif [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20')
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:36:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] No VIF found with MAC fa:16:3e:16:63:ee, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:36:58 user nova-compute[82009]: DEBUG nova.network.neutron [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Updated VIF entry in instance network info cache for port 223b0c54-2078-474a-96f4-91346bd1c1ff. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:36:58 user nova-compute[82009]: DEBUG nova.network.neutron [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Updating instance_info_cache with network_info: [{"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:36:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f8985ef7-1565-4a82-a621-83d3775114c1 req-bca1a5d6-1f06-456b-85df-6953b83329de service nova] Releasing lock "refresh_cache-73cbcd59-6e6a-4950-8dae-738f3b7151ac" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:36:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:36:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] No waiting events found dispatching network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:36:59 user nova-compute[82009]: WARNING nova.compute.manager [req-7445ca44-7907-4392-bcc4-6d55b361c1e1 req-318e9fa1-b49e-47fc-8bde-64b0d576c371 service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received unexpected event network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff for instance with vm_state building and task_state spawning.
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238221.2216444, 73cbcd59-6e6a-4950-8dae-738f3b7151ac => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] VM Resumed (Lifecycle Event)
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Instance spawned successfully.
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238221.223139, 73cbcd59-6e6a-4950-8dae-738f3b7151ac => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] VM Started (Lifecycle Event)
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:37:01 user nova-compute[82009]: INFO nova.compute.manager [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Took 6.51 seconds to build instance.
Apr 11 18:37:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cfc44738-43ce-44b8-a345-9e465a91f1cd tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:01 user nova-compute[82009]: DEBUG nova.compute.manager [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] No waiting events found dispatching network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:37:01 user nova-compute[82009]: WARNING nova.compute.manager [req-feb360b4-938b-4b53-a6b7-1d88013c4c0a req-7fe71f5b-18f0-486a-ad7e-03c22bc36f0d service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received unexpected event network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff for instance with vm_state active and task_state None.
Apr 11 18:37:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:04 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:37:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:37:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:37:13 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:37:13 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:37:14 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [{"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:37:14 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-13a5f428-afe3-495a-80f5-b72b494a064a" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:37:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:37:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:15 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:37:17 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:37:17 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:37:17 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8320MB free_disk=26.104660034179688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 13a5f428-afe3-495a-80f5-b72b494a064a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9a1efd21-1752-4335-841a-3669ac667247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:37:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:37:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:37:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-changed-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:37:30 user nova-compute[82009]: DEBUG nova.compute.manager [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Refreshing instance network info cache due to event network-changed-c667caf2-9e07-4a9e-a45f-d5f10898124a. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:37:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Acquiring lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:37:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Acquired lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:37:30 user nova-compute[82009]: DEBUG nova.network.neutron [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Refreshing network info cache for port c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:37:31 user nova-compute[82009]: DEBUG nova.network.neutron [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updated VIF entry in instance network info cache for port c667caf2-9e07-4a9e-a45f-d5f10898124a. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:37:31 user nova-compute[82009]: DEBUG nova.network.neutron [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updating instance_info_cache with network_info: [{"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:37:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-f128f4f8-2a3b-4adf-97d5-cc33b1b713ef req-2c781f16-deb4-4350-b3aa-3b57666a887d service nova] Releasing lock "refresh_cache-9a1efd21-1752-4335-841a-3669ac667247" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG nova.objects.instance [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:32 user nova-compute[82009]: INFO nova.compute.manager [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Attaching volume 71f31b39-56a1-452d-ae13-1175640a02c1 to /dev/vdb
Apr 11 18:37:32 user nova-compute[82009]: DEBUG os_brick.utils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de06e1d-33df-497f-a7f4-116610cc84cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e32d2-411f-45ad-a17b-e703baa7a3ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b03707-02d7-4d83-b138-f34506824d36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24ea4cb-9c33-43c7-a901-ed5ba67a2f67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:37:32 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:37:32 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d417147-0d9d-42d7-928f-b6416d56beff]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG os_brick.utils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updating existing volume attachment record: 57ded67a-86cd-4fb0-b6e3-951aeb6b2c5a {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJcpCTnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:37:36 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:37:36 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:37:36 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ae1df1-6966-48c3-9518-e4eff1ac4109]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:37:36 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c218a-1481-432f-8da1-d6d9b4d3cfef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1] added
Apr 11 18:37:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470331b-eb56-4cc5-86d0-1ba43ae985ee]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90d573-bd03-45d6-a503-75dae573680d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJcpCTnX {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJcpCTnX" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc630d9-4a6b-4378-aec2-bbaf92538b00]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aJcpCTnX'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[884cb7f5-2346-4ae1-9a55-35e9b6b15272]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[923bed62-ab1d-4e30-9a45-743701ea364e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba7d551-fc94-4d30-91e4-daa7faab5796]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260]
Apr 11 18:37:36 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260] successful.
Apr 11 18:37:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b6f84-b0e0-42f2-b961-72eaa66f2fab]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350d171-9cf0-4d34-9bdb-af310aad47dd]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 (non-flash)
Apr 11 18:37:36 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd66ac0-b151-4bd7-a0a8-6811f2f8811b]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:36 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJcpCTnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23463653863303131', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463653863303131', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG nova.objects.instance [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:37:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:37:38 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:37:38 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:37:38 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:37:38 user nova-compute[82009]:   <serial>71f31b39-56a1-452d-ae13-1175640a02c1</serial>
Apr 11 18:37:38 user nova-compute[82009]: </disk>
Apr 11 18:37:38 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:37:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:37:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:37:38 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:81:96:81, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:37:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-1f3d2e95-a96b-4fbd-9fc9-81004a47bdf8 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.113s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:39 user nova-compute[82009]: INFO nova.compute.manager [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Detaching volume 71f31b39-56a1-452d-ae13-1175640a02c1
Apr 11 18:37:39 user nova-compute[82009]: INFO nova.virt.block_device [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Attempting to driver detach volume 71f31b39-56a1-452d-ae13-1175640a02c1 from mountpoint /dev/vdb
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Attempting to detach device vdb from instance 9a1efd21-1752-4335-841a-3669ac667247 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:37:39 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:37:39 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:37:39 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:37:39 user nova-compute[82009]:   <serial>71f31b39-56a1-452d-ae13-1175640a02c1</serial>
Apr 11 18:37:39 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:37:39 user nova-compute[82009]: </disk>
Apr 11 18:37:39 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:37:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully detached device vdb from instance 9a1efd21-1752-4335-841a-3669ac667247 from the persistent domain config.
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a1efd21-1752-4335-841a-3669ac667247 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:37:39 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:37:39 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:37:39 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:37:39 user nova-compute[82009]:   <serial>71f31b39-56a1-452d-ae13-1175640a02c1</serial>
Apr 11 18:37:39 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:37:39 user nova-compute[82009]: </disk>
Apr 11 18:37:39 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238259.8594515, 9a1efd21-1752-4335-841a-3669ac667247 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:37:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully detached device vdb from instance 9a1efd21-1752-4335-841a-3669ac667247 from the live domain config.
Apr 11 18:37:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJcpCTnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:37:39 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770a1b3-c8f2-4a53-9091-b9a9998f3b1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:37:39 user nova-compute[82009]: No targets found.
Apr 11 18:37:39 user nova-compute[82009]: iSNS:
Apr 11 18:37:39 user nova-compute[82009]: No targets found.
Apr 11 18:37:39 user nova-compute[82009]: STATIC:
Apr 11 18:37:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1
Apr 11 18:37:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:37:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:37:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:37:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:37:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:37:39 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:37:39 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:37:39 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:37:39 user nova-compute[82009]: FIRMWARE:
Apr 11 18:37:39 user nova-compute[82009]: No targets found.
Apr 11 18:37:39 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:37:39 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:37:39 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d0d144-fcc7-4b1b-bc87-3cb378719685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcfa58a-4e12-4213-922a-09c0658919d7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:39 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:39 user nova-compute[82009]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 (non-flash)
Apr 11 18:37:39 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:39 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:39 user nova-compute[82009]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 (non-flash)
Apr 11 18:37:39 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c627be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fc20dc-4d91-4623-8b98-511738c67c15]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6b8369-cb63-4719-a6e6-adfc3284c393]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:37:39 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484f57a-8f2d-40a0-9810-ae88871d5fa8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[26120537-7c70-4ee9-9c30-5a87ad11ba28]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a2f4f-d3a9-4133-9608-60a47c35d6eb]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fb4daf-2422-4353-a6a8-699995462eeb]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260]
Apr 11 18:37:40 user nova-compute[82009]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1, portal: 172.16.0.220,3260] successful.
Apr 11 18:37:40 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f31b39-56a1-452d-ae13-1175640a02c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54802fe-9db2-489a-98eb-749faaccb791]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== disconnect_volume: return (321ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG nova.objects.instance [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:37:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-0cdc1b58-6f23-4f06-8807-ccbbd11ae48f tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "13a5f428-afe3-495a-80f5-b72b494a064a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:48 user nova-compute[82009]: INFO nova.compute.manager [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Terminating instance
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.compute.manager [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.compute.manager [req-c0b2c701-fd15-482c-8eee-e02c6324ac26 req-27f03532-3cb9-41bd-91b3-5331816cc56a service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-unplugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Instance destroyed successfully.
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'resources' on Instance uuid 13a5f428-afe3-495a-80f5-b72b494a064a {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:32:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1226293529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1226293529',id=41,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:34:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-d6taj3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:36:02Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=13a5f428-afe3-495a-80f5-b72b494a064a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "3d45cf5a-175a-4bca-9c73-119f3456643a", "address": "fa:16:3e:db:18:61", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d45cf5a-17", "ovs_interfaceid": "3d45cf5a-175a-4bca-9c73-119f3456643a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_vif [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d45cf5a-17, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:37:48 user nova-compute[82009]: INFO os_vif [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:18:61,bridge_name='br-int',has_traffic_filtering=True,id=3d45cf5a-175a-4bca-9c73-119f3456643a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d45cf5a-17')
Apr 11 18:37:48 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NLqDlgeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:37:48 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5d3fd0-0b0d-4efa-a63e-a6e0fb606ffb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:37:48 user nova-compute[82009]: No targets found.
Apr 11 18:37:48 user nova-compute[82009]: iSNS:
Apr 11 18:37:48 user nova-compute[82009]: No targets found.
Apr 11 18:37:48 user nova-compute[82009]: STATIC:
Apr 11 18:37:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:37:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:37:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:37:48 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9
Apr 11 18:37:48 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:37:48 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:37:48 user nova-compute[82009]: FIRMWARE:
Apr 11 18:37:48 user nova-compute[82009]: No targets found.
Apr 11 18:37:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:37:48 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:37:48 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2872f05-2ad8-41b1-a4dd-057b7cb52bc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9269cc85-6e14-4ea2-bed9-26bc3291e27d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:48 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:37:48 user nova-compute[82009]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 (non-flash)
Apr 11 18:37:48 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c624c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9'): ({'sdf'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:37:48 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Removing single pathed devices sdf {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a2184-a2d2-4db6-b81a-29fdc2aee133]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8461ec-d8e1-4864-b7dc-340065e2a4fc]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flushing IO for device /dev/sdf {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d965f-b623-4b0b-850d-9ff7382956a1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8396ec0f-2b27-4a9e-bdbf-d8f500edd30d]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] SCSI volumes sdf have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4500cc35-3bf4-4218-a8a5-897a8ecb16ea]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[531557d1-8623-4c57-aeef-4463fa677568]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260]
Apr 11 18:37:49 user nova-compute[82009]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9, portal: 172.16.0.220,3260] successful.
Apr 11 18:37:49 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0eeb9b5-c668-49a8-9e24-7452295c3da9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db8ec4-aca4-4b07-b6f0-a4494226af9d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== disconnect_volume: return (291ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:37:49 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Deleting instance files /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a_del
Apr 11 18:37:49 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Deletion of /opt/stack/data/nova/instances/13a5f428-afe3-495a-80f5-b72b494a064a_del complete
Apr 11 18:37:49 user nova-compute[82009]: INFO nova.compute.manager [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 18:37:49 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:37:49 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Took 0.56 seconds to deallocate network for instance.
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-deleted-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:37:49 user nova-compute[82009]: INFO nova.compute.manager [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Neutron deleted interface 3d45cf5a-175a-4bca-9c73-119f3456643a; detaching it from the instance and deleting it from the info cache
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.network.neutron [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:37:49 user nova-compute[82009]: DEBUG nova.compute.manager [req-0d53a7c5-2a6b-4fcf-8fa5-385fb8a965b6 req-3af2e294-9c9c-44fe-93eb-b3245411a0e3 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Detach interface failed, port_id=3d45cf5a-175a-4bca-9c73-119f3456643a, reason: Instance 13a5f428-afe3-495a-80f5-b72b494a064a could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Acquiring lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] Lock "13a5f428-afe3-495a-80f5-b72b494a064a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG nova.compute.manager [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] No waiting events found dispatching network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:37:50 user nova-compute[82009]: WARNING nova.compute.manager [req-b0e078f2-3d19-4c1b-a2f3-8083701ea99c req-ec97e0b5-b303-4225-aae3-e8d20cac1200 service nova] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Received unexpected event network-vif-plugged-3d45cf5a-175a-4bca-9c73-119f3456643a for instance with vm_state active and task_state deleting.
Apr 11 18:37:50 user nova-compute[82009]: INFO nova.compute.manager [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 18:37:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:37:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:50 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Deleted allocations for instance 13a5f428-afe3-495a-80f5-b72b494a064a
Apr 11 18:37:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ba8679a3-718d-4ca8-be51-c70b62c7c2ab tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "13a5f428-afe3-495a-80f5-b72b494a064a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.968s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:37:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:37:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:37:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:37:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:37:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:37:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:03 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238268.867069, 13a5f428-afe3-495a-80f5-b72b494a064a => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:38:03 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] VM Stopped (Lifecycle Event)
Apr 11 18:38:03 user nova-compute[82009]: DEBUG nova.compute.manager [None req-075080f5-2575-472a-b6a5-348681fd5612 None None] [instance: 13a5f428-afe3-495a-80f5-b72b494a064a] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:38:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:06 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:38:14 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:38:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:17 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:38:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:38:19 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8366MB free_disk=26.10315704345703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 91053286-2092-4540-a527-564c0cf78bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 9a1efd21-1752-4335-841a-3669ac667247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:38:19 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:38:20 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:38:20 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:38:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:38:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:38:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:38:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:38:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:29 user nova-compute[82009]: INFO nova.compute.manager [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Terminating instance
Apr 11 18:38:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-vif-unplugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] No waiting events found dispatching network-vif-unplugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:38:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-b6e03dc5-d680-4092-abd4-2915c504abdc req-6c9d8975-b0e4-4a9b-8ab7-c63d1f32a029 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-vif-unplugged-c667caf2-9e07-4a9e-a45f-d5f10898124a for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:38:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Instance destroyed successfully.
Apr 11 18:38:30 user nova-compute[82009]: DEBUG nova.objects.instance [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'resources' on Instance uuid 9a1efd21-1752-4335-841a-3669ac667247 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-328545184',display_name='tempest-AttachVolumeNegativeTest-server-328545184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-328545184',id=44,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3IjFSFuUivBNpfQF2rtSYTbcXASfl6aabS3bgmO/p7n8BH94qlrQ3XnifiKs1PEA2gzpUr4NAP6XOtmsOqapxYUVA4fW/2Q1ESbSxPS1dDRrkl21GGjOby2LesnRQWgA==',key_name='tempest-keypair-2138755154',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:35:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-ez7073mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=9a1efd21-1752-4335-841a-3669ac667247,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "address": "fa:16:3e:81:96:81", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc667caf2-9e", "ovs_interfaceid": "c667caf2-9e07-4a9e-a45f-d5f10898124a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG os_vif [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc667caf2-9e, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:38:30 user nova-compute[82009]: INFO os_vif [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:96:81,bridge_name='br-int',has_traffic_filtering=True,id=c667caf2-9e07-4a9e-a45f-d5f10898124a,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc667caf2-9e')
Apr 11 18:38:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Deleting instance files /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247_del
Apr 11 18:38:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Deletion of /opt/stack/data/nova/instances/9a1efd21-1752-4335-841a-3669ac667247_del complete
Apr 11 18:38:30 user nova-compute[82009]: INFO nova.compute.manager [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 18:38:30 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:38:30 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:38:31 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:38:31 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Took 0.85 seconds to deallocate network for instance.
Apr 11 18:38:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:31 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:38:31 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:38:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:31 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Deleted allocations for instance 9a1efd21-1752-4335-841a-3669ac667247
Apr 11 18:38:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4e4518c0-f835-4d30-9d1e-d01301c2dcfd tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "9a1efd21-1752-4335-841a-3669ac667247" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Acquiring lock "9a1efd21-1752-4335-841a-3669ac667247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] Lock "9a1efd21-1752-4335-841a-3669ac667247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] No waiting events found dispatching network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:38:32 user nova-compute[82009]: WARNING nova.compute.manager [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received unexpected event network-vif-plugged-c667caf2-9e07-4a9e-a45f-d5f10898124a for instance with vm_state deleted and task_state None.
Apr 11 18:38:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-bdb4271a-9172-4ef1-a3f8-c2d5220c4542 req-22755943-8057-47d3-9b3a-c20a66088e03 service nova] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Received event network-vif-deleted-c667caf2-9e07-4a9e-a45f-d5f10898124a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "91053286-2092-4540-a527-564c0cf78bd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:38 user nova-compute[82009]: INFO nova.compute.manager [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Terminating instance
Apr 11 18:38:38 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-vif-unplugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] No waiting events found dispatching network-vif-unplugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:38:38 user nova-compute[82009]: DEBUG nova.compute.manager [req-7c35caaa-fd41-4d94-887c-9e64575e7704 req-c5ed687e-4cc5-47c7-90d2-647910fcf7e2 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-vif-unplugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Instance destroyed successfully.
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'resources' on Instance uuid 91053286-2092-4540-a527-564c0cf78bd3 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-966866756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-966866756',id=38,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-k0n2bzh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:31:13Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=91053286-2092-4540-a527-564c0cf78bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "address": "fa:16:3e:ed:32:ea", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5910cd2-0e", "ovs_interfaceid": "b5910cd2-0ef5-4d68-8dcf-5031c519642a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG os_vif [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5910cd2-0e, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:39 user nova-compute[82009]: INFO os_vif [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:32:ea,bridge_name='br-int',has_traffic_filtering=True,id=b5910cd2-0ef5-4d68-8dcf-5031c519642a,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5910cd2-0e')
Apr 11 18:38:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Deleting instance files /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3_del
Apr 11 18:38:39 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Deletion of /opt/stack/data/nova/instances/91053286-2092-4540-a527-564c0cf78bd3_del complete
Apr 11 18:38:39 user nova-compute[82009]: INFO nova.compute.manager [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 11 18:38:39 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:38:39 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Took 0.52 seconds to deallocate network for instance.
Apr 11 18:38:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:39 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:40 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:38:40 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:38:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:40 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Deleted allocations for instance 91053286-2092-4540-a527-564c0cf78bd3
Apr 11 18:38:40 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9264ee93-8d0d-46b0-b3e8-70da7e860563 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "91053286-2092-4540-a527-564c0cf78bd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.592s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Acquiring lock "91053286-2092-4540-a527-564c0cf78bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:41 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] Lock "91053286-2092-4540-a527-564c0cf78bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] No waiting events found dispatching network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:38:41 user nova-compute[82009]: WARNING nova.compute.manager [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received unexpected event network-vif-plugged-b5910cd2-0ef5-4d68-8dcf-5031c519642a for instance with vm_state deleted and task_state None.
Apr 11 18:38:41 user nova-compute[82009]: DEBUG nova.compute.manager [req-91df190d-a730-431d-8d04-86248d7a0ade req-4af04de5-498b-4b24-9466-2509728904a0 service nova] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Received event network-vif-deleted-b5910cd2-0ef5-4d68-8dcf-5031c519642a {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:45 user nova-compute[82009]: INFO nova.compute.manager [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Terminating instance
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-vif-unplugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] No waiting events found dispatching network-vif-unplugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.compute.manager [req-3aa53816-3dc3-4972-9ae4-c6105afdf8bf req-295fd66c-9ca1-4bf6-8e47-88b7dcd53faf service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-vif-unplugged-223b0c54-2078-474a-96f4-91346bd1c1ff for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238310.427979, 9a1efd21-1752-4335-841a-3669ac667247 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:38:45 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 9a1efd21-1752-4335-841a-3669ac667247] VM Stopped (Lifecycle Event)
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.compute.manager [None req-44c9e8d1-5cc7-4371-a546-86287dd1eb28 None None] [instance: 9a1efd21-1752-4335-841a-3669ac667247] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:38:45 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Instance destroyed successfully.
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.objects.instance [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lazy-loading 'resources' on Instance uuid 73cbcd59-6e6a-4950-8dae-738f3b7151ac {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-508320532',display_name='tempest-ServersNegativeTestJSON-server-508320532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-508320532',id=45,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:37:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='423994357c024575acae85fb885f4069',ramdisk_id='',reservation_id='r-969kupzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1378388549',owner_user_name='tempest-ServersNegativeTestJSON-1378388549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:37:01Z,user_data=None,user_id='423f3e46d47448fb880c9eeb1281565a',uuid=73cbcd59-6e6a-4950-8dae-738f3b7151ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converting VIF {"id": "223b0c54-2078-474a-96f4-91346bd1c1ff", "address": "fa:16:3e:16:63:ee", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap223b0c54-20", "ovs_interfaceid": "223b0c54-2078-474a-96f4-91346bd1c1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG os_vif [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap223b0c54-20, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: INFO os_vif [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:ee,bridge_name='br-int',has_traffic_filtering=True,id=223b0c54-2078-474a-96f4-91346bd1c1ff,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap223b0c54-20')
Apr 11 18:38:45 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Deleting instance files /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac_del
Apr 11 18:38:45 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Deletion of /opt/stack/data/nova/instances/73cbcd59-6e6a-4950-8dae-738f3b7151ac_del complete
Apr 11 18:38:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:45 user nova-compute[82009]: INFO nova.compute.manager [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 18:38:45 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:38:45 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:38:46 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Took 0.43 seconds to deallocate network for instance.
Apr 11 18:38:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-vif-deleted-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:46 user nova-compute[82009]: INFO nova.compute.manager [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Neutron deleted interface 223b0c54-2078-474a-96f4-91346bd1c1ff; detaching it from the instance and deleting it from the info cache
Apr 11 18:38:46 user nova-compute[82009]: DEBUG nova.network.neutron [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-413913bb-1473-4db7-bbfb-0af6694c13f8 req-76286e29-aaf7-41be-8fb2-2fc12818ca8a service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Detach interface failed, port_id=223b0c54-2078-474a-96f4-91346bd1c1ff, reason: Instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:38:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:46 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Deleted allocations for instance 73cbcd59-6e6a-4950-8dae-738f3b7151ac
Apr 11 18:38:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-aed571b5-cc6f-4dab-be44-926999d3a304 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.443s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received event network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:38:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Acquiring lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:38:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:38:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] Lock "73cbcd59-6e6a-4950-8dae-738f3b7151ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:38:47 user nova-compute[82009]: DEBUG nova.compute.manager [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] No waiting events found dispatching network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:38:47 user nova-compute[82009]: WARNING nova.compute.manager [req-8016ad3a-91ec-41c7-91e1-0333540d61c5 req-759c4c10-4f9e-4acf-9d8a-ecb290bb2f9f service nova] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Received unexpected event network-vif-plugged-223b0c54-2078-474a-96f4-91346bd1c1ff for instance with vm_state deleted and task_state None.
Apr 11 18:38:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:38:54 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238319.3004394, 91053286-2092-4540-a527-564c0cf78bd3 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:38:54 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 91053286-2092-4540-a527-564c0cf78bd3] VM Stopped (Lifecycle Event)
Apr 11 18:38:54 user nova-compute[82009]: DEBUG nova.compute.manager [None req-59bc64a4-9584-4e17-b39d-bce3b0a2b351 None None] [instance: 91053286-2092-4540-a527-564c0cf78bd3] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:38:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:00 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238325.5789275, 73cbcd59-6e6a-4950-8dae-738f3b7151ac => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:39:00 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] VM Stopped (Lifecycle Event)
Apr 11 18:39:00 user nova-compute[82009]: DEBUG nova.compute.manager [None req-923a04f9-d579-47c5-8c8b-a70006e49208 None None] [instance: 73cbcd59-6e6a-4950-8dae-738f3b7151ac] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:39:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:11 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:39:15 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:39:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:39:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:39:16 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:39:16 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:39:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [{"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:39:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-a0d74109-f1ce-4361-a037-d23d348f8d3d" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:39:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:39:18 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:18 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:19 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82009) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 18:39:20 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:39:20 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=26.23324966430664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance a0d74109-f1ce-4361-a037-d23d348f8d3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance bef10824-ced0-49d5-934a-c509ab119cbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:39:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:23 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:39:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:39:24 user nova-compute[82009]: INFO nova.compute.claims [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Claim successful on node user
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:39:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.policy [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b91adf882c384c8c9e27a24a8c55b0a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92ba4ae3f244cfc9f3f0732ab9cc649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:39:24 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Creating image(s)
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "/opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.134s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.147s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk 1073741824" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Successfully created port: 83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Cannot resize image /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.objects.instance [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'migration_context' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Ensure instance console log exists: /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Successfully updated port: 83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquired lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-changed-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.compute.manager [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Refreshing instance network info cache due to event network-changed-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Acquiring lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:39:25 user nova-compute[82009]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.neutron [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updating instance_info_cache with network_info: [{"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Releasing lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Instance network_info: |[{"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Acquired lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Refreshing network info cache for port 83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Start _get_guest_xml network_info=[{"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:39:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:39:26 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1928714156',display_name='tempest-AttachVolumeNegativeTest-server-1928714156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1928714156',id=46,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqjtlcvFTOedW1tCltpV4NHM/VDv1sc6WJxf/MgmIAxMR51lkgELeDrhXhArbJRvpPAA3hKYozM1eCrhx/nOdUEQZ0SRgpKm30preBDIvt3XYB9AP5jIp2h9nLW+gtikQ==',key_name='tempest-keypair-994113133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-l0erruyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=d2623107-c830-4c81-a534-b5d7dc0ca10f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.objects.instance [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'pci_devices' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:39:26 user nova-compute[82009]:   <uuid>d2623107-c830-4c81-a534-b5d7dc0ca10f</uuid>
Apr 11 18:39:26 user nova-compute[82009]:   <name>instance-0000002e</name>
Apr 11 18:39:26 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:39:26 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:39:26 user nova-compute[82009]:   <metadata>
Apr 11 18:39:26 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:39:26 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:39:26 user nova-compute[82009]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1928714156</nova:name>
Apr 11 18:39:26 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:39:26</nova:creationTime>
Apr 11 18:39:26 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:39:26 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:39:26 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:39:26 user nova-compute[82009]:       <nova:owner>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:user uuid="b91adf882c384c8c9e27a24a8c55b0a1">tempest-AttachVolumeNegativeTest-1806714760-project-member</nova:user>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:project uuid="a92ba4ae3f244cfc9f3f0732ab9cc649">tempest-AttachVolumeNegativeTest-1806714760</nova:project>
Apr 11 18:39:26 user nova-compute[82009]:       </nova:owner>
Apr 11 18:39:26 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:39:26 user nova-compute[82009]:       <nova:ports>
Apr 11 18:39:26 user nova-compute[82009]:         <nova:port uuid="83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6">
Apr 11 18:39:26 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 18:39:26 user nova-compute[82009]:         </nova:port>
Apr 11 18:39:26 user nova-compute[82009]:       </nova:ports>
Apr 11 18:39:26 user nova-compute[82009]:     </nova:instance>
Apr 11 18:39:26 user nova-compute[82009]:   </metadata>
Apr 11 18:39:26 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:39:26 user nova-compute[82009]:     <system>
Apr 11 18:39:26 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:39:26 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:39:26 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:39:26 user nova-compute[82009]:       <entry name="serial">d2623107-c830-4c81-a534-b5d7dc0ca10f</entry>
Apr 11 18:39:26 user nova-compute[82009]:       <entry name="uuid">d2623107-c830-4c81-a534-b5d7dc0ca10f</entry>
Apr 11 18:39:26 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:39:26 user nova-compute[82009]:     </system>
Apr 11 18:39:26 user nova-compute[82009]:   </sysinfo>
Apr 11 18:39:26 user nova-compute[82009]:   <os>
Apr 11 18:39:26 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:39:26 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:39:26 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:39:26 user nova-compute[82009]:   </os>
Apr 11 18:39:26 user nova-compute[82009]:   <features>
Apr 11 18:39:26 user nova-compute[82009]:     <acpi/>
Apr 11 18:39:26 user nova-compute[82009]:     <apic/>
Apr 11 18:39:26 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:39:26 user nova-compute[82009]:   </features>
Apr 11 18:39:26 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:39:26 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:39:26 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:39:26 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:39:26 user nova-compute[82009]:   </clock>
Apr 11 18:39:26 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:39:26 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:39:26 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:39:26 user nova-compute[82009]:   </cpu>
Apr 11 18:39:26 user nova-compute[82009]:   <devices>
Apr 11 18:39:26 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:39:26 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:39:26 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk"/>
Apr 11 18:39:26 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:39:26 user nova-compute[82009]:     </disk>
Apr 11 18:39:26 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:39:26 user nova-compute[82009]:       <mac address="fa:16:3e:e4:3d:17"/>
Apr 11 18:39:26 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:39:26 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:39:26 user nova-compute[82009]:       <target dev="tap83e4de5d-dc"/>
Apr 11 18:39:26 user nova-compute[82009]:     </interface>
Apr 11 18:39:26 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:39:26 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/console.log" append="off"/>
Apr 11 18:39:26 user nova-compute[82009]:     </serial>
Apr 11 18:39:26 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:39:26 user nova-compute[82009]:     <video>
Apr 11 18:39:26 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:39:26 user nova-compute[82009]:     </video>
Apr 11 18:39:26 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:39:26 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:39:26 user nova-compute[82009]:     </rng>
Apr 11 18:39:26 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:39:26 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:39:26 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:39:26 user nova-compute[82009]:     </memballoon>
Apr 11 18:39:26 user nova-compute[82009]:   </devices>
Apr 11 18:39:26 user nova-compute[82009]: </domain>
Apr 11 18:39:26 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1928714156',display_name='tempest-AttachVolumeNegativeTest-server-1928714156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1928714156',id=46,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqjtlcvFTOedW1tCltpV4NHM/VDv1sc6WJxf/MgmIAxMR51lkgELeDrhXhArbJRvpPAA3hKYozM1eCrhx/nOdUEQZ0SRgpKm30preBDIvt3XYB9AP5jIp2h9nLW+gtikQ==',key_name='tempest-keypair-994113133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-l0erruyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=d2623107-c830-4c81-a534-b5d7dc0ca10f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG os_vif [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83e4de5d-dc, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83e4de5d-dc, col_values=(('external_ids', {'iface-id': '83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:3d:17', 'vm-uuid': 'd2623107-c830-4c81-a534-b5d7dc0ca10f'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:26 user nova-compute[82009]: INFO os_vif [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc')
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:e4:3d:17, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updated VIF entry in instance network info cache for port 83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG nova.network.neutron [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updating instance_info_cache with network_info: [{"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:39:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3b85384b-a15c-474c-9d9b-8976dc2ed6f3 req-7a753ae4-2eb7-47b7-87ec-617714b4f6c2 service nova] Releasing lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:27 user nova-compute[82009]: DEBUG nova.compute.manager [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] No waiting events found dispatching network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:39:27 user nova-compute[82009]: WARNING nova.compute.manager [req-aa6083d9-0b57-48d5-8d75-4354fa82dcdc req-989d0496-67fc-44b0-a24d-81cdbe7126b6 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received unexpected event network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance with vm_state building and task_state spawning.
Apr 11 18:39:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Terminating instance
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-65c0d653-f876-498d-a22d-26185e0f0946 req-2bbeae7b-fb4a-4c66-b6b6-acdcf59fc256 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-unplugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238369.7187762, d2623107-c830-4c81-a534-b5d7dc0ca10f => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] VM Resumed (Lifecycle Event)
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Instance spawned successfully.
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238369.7227194, d2623107-c830-4c81-a534-b5d7dc0ca10f => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] VM Started (Lifecycle Event)
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Instance destroyed successfully.
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.objects.instance [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'resources' on Instance uuid bef10824-ced0-49d5-934a-c509ab119cbf {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1868063970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1868063970',id=31,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:25:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-n3t3bpyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:27:30Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=bef10824-ced0-49d5-934a-c509ab119cbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "address": "fa:16:3e:78:f3:ac", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d7d0-fb", "ovs_interfaceid": "d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG os_vif [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:39:29 user nova-compute[82009]: INFO nova.compute.manager [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Took 5.92 seconds to build instance.
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a4d7d0-fb, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:29 user nova-compute[82009]: INFO os_vif [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:f3:ac,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d7d0-fb')
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEQxHqeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:39:29 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:39:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-40392f5e-a2ef-4bf7-afc2-5b1550cb14e3 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.023s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:29 user nova-compute[82009]: DEBUG nova.compute.manager [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] No waiting events found dispatching network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:39:29 user nova-compute[82009]: WARNING nova.compute.manager [req-08628e26-ecd5-491e-bf12-e0a61b294698 req-36e6f3ff-04ff-403a-aa2f-2ff2b0e2cc65 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received unexpected event network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance with vm_state active and task_state None.
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bfc6bd-6165-4ef6-844e-ed94ffa0baeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:39:30 user nova-compute[82009]: No targets found.
Apr 11 18:39:30 user nova-compute[82009]: iSNS:
Apr 11 18:39:30 user nova-compute[82009]: No targets found.
Apr 11 18:39:30 user nova-compute[82009]: STATIC:
Apr 11 18:39:30 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937
Apr 11 18:39:30 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:39:30 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:39:30 user nova-compute[82009]: FIRMWARE:
Apr 11 18:39:30 user nova-compute[82009]: No targets found.
Apr 11 18:39:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:39:30 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:39:30 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acecb48-e252-424e-b43a-6e058f3bc569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d7d596-e5ca-496c-b678-840d54902606]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:39:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 (non-flash)
Apr 11 18:39:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3d828add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937'): ({'sdc'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Removing single pathed devices sdc {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d668f-8aae-4125-b489-b89e659a34c0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a41164e-51c0-40d6-8384-6fc9960643a3]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Flushing IO for device /dev/sdc {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0315f90-e188-4be4-b898-dbda7c49ac51]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b615e6e8-f919-4d4c-a10c-5ef5e93f9452]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] SCSI volumes sdc have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b488a2-fc94-4cb3-964a-100d42b747bf]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ccb03-3e51-4d7b-9562-92d72a5d5d8c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260]
Apr 11 18:39:30 user nova-compute[82009]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937, portal: 172.16.0.220,3260] successful.
Apr 11 18:39:30 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca57292f-f0c4-4b01-87ee-f7266c363937 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bb6174-2144-4919-9a80-aeb383976cc0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] <== disconnect_volume: return (304ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:39:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Deleting instance files /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf_del
Apr 11 18:39:30 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Deletion of /opt/stack/data/nova/instances/bef10824-ced0-49d5-934a-c509ab119cbf_del complete
Apr 11 18:39:30 user nova-compute[82009]: INFO nova.compute.manager [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 18:39:30 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:39:30 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:39:30 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Took 0.49 seconds to deallocate network for instance.
Apr 11 18:39:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Acquiring lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] Lock "bef10824-ced0-49d5-934a-c509ab119cbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG nova.compute.manager [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] No waiting events found dispatching network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:39:31 user nova-compute[82009]: WARNING nova.compute.manager [req-a7929e45-d27b-42dd-bde5-9477880de6b3 req-43db32e1-0c06-4984-97bc-dd32ee805e27 service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received unexpected event network-vif-plugged-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 for instance with vm_state active and task_state deleting.
Apr 11 18:39:31 user nova-compute[82009]: INFO nova.compute.manager [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Took 0.90 seconds to detach 1 volumes for instance.
Apr 11 18:39:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:39:31 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:39:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:32 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Deleted allocations for instance bef10824-ced0-49d5-934a-c509ab119cbf
Apr 11 18:39:32 user nova-compute[82009]: DEBUG nova.compute.manager [req-b26c4a67-9742-49d4-a618-ad43a20e36a2 req-9f4a652f-eba7-42c8-8f90-2a048fc40cda service nova] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Received event network-vif-deleted-d2a4d7d0-fba2-45e6-ac74-ccbf69ef66e9 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:39:32 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-4ba39e05-6022-4180-bc85-2fe1432eda25 tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "bef10824-ced0-49d5-934a-c509ab119cbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.969s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:39:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:34 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:39 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:44 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238369.9180532, bef10824-ced0-49d5-934a-c509ab119cbf => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:39:44 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] VM Stopped (Lifecycle Event)
Apr 11 18:39:44 user nova-compute[82009]: DEBUG nova.compute.manager [None req-e745cf93-1a7e-4583-ab50-84b0bf25a625 None None] [instance: bef10824-ced0-49d5-934a-c509ab119cbf] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:39:44 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:39:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:39:59 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:04 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:09 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:40:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:40:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:40:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:40:18 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updating instance_info_cache with network_info: [{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:40:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:40:18 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:19 user nova-compute[82009]: INFO nova.compute.manager [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Terminating instance
Apr 11 18:40:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:19 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-vif-unplugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] No waiting events found dispatching network-vif-unplugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.compute.manager [req-02c1aedb-c4b5-457f-bfde-4023b1548633 req-b100f7c8-424b-4f65-bb61-8eb52c9913e2 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-vif-unplugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Instance destroyed successfully.
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lazy-loading 'resources' on Instance uuid a0d74109-f1ce-4361-a037-d23d348f8d3d {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-690899682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-690899682',id=27,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:20:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a254c432f54e1b8735e40af7063506',ramdisk_id='',reservation_id='r-fzuhuicy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:22:42Z,user_data=None,user_id='fde784625fda4447afc0b8e9bd0983a3',uuid=a0d74109-f1ce-4361-a037-d23d348f8d3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converting VIF {"id": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "address": "fa:16:3e:74:d0:f2", "network": {"id": "c65d6737-91d9-40cd-a03c-f8049dc621fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-58397308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a254c432f54e1b8735e40af7063506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2ce54aa-80", "ovs_interfaceid": "d2ce54aa-8057-41b6-98ca-988a0fd0491c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG os_vif [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2ce54aa-80, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:20 user nova-compute[82009]: INFO os_vif [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:d0:f2,bridge_name='br-int',has_traffic_filtering=True,id=d2ce54aa-8057-41b6-98ca-988a0fd0491c,network=Network(c65d6737-91d9-40cd-a03c-f8049dc621fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2ce54aa-80')
Apr 11 18:40:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Deleting instance files /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d_del
Apr 11 18:40:20 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Deletion of /opt/stack/data/nova/instances/a0d74109-f1ce-4361-a037-d23d348f8d3d_del complete
Apr 11 18:40:20 user nova-compute[82009]: INFO nova.compute.manager [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:40:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-vif-deleted-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:40:21 user nova-compute[82009]: INFO nova.compute.manager [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Neutron deleted interface d2ce54aa-8057-41b6-98ca-988a0fd0491c; detaching it from the instance and deleting it from the info cache
Apr 11 18:40:21 user nova-compute[82009]: DEBUG nova.network.neutron [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:40:21 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Took 0.52 seconds to deallocate network for instance.
Apr 11 18:40:21 user nova-compute[82009]: DEBUG nova.compute.manager [req-42e4f1be-a757-4f6c-98f9-e24f878dcbbc req-68192d2c-c87d-4801-a283-2932148dd8b5 service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Detach interface failed, port_id=d2ce54aa-8057-41b6-98ca-988a0fd0491c, reason: Instance a0d74109-f1ce-4361-a037-d23d348f8d3d could not be found. {{(pid=82009) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:21 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Deleted allocations for instance a0d74109-f1ce-4361-a037-d23d348f8d3d
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6d6b63a0-1d4c-4bbb-be7b-5509c69651dc tempest-ServerBootFromVolumeStableRescueTest-1689319261 tempest-ServerBootFromVolumeStableRescueTest-1689319261-project-member] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.704s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:40:22 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:40:22 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=26.30295181274414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d2623107-c830-4c81-a534-b5d7dc0ca10f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.manager [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received event network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Acquiring lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] Lock "a0d74109-f1ce-4361-a037-d23d348f8d3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.manager [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] No waiting events found dispatching network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:40:22 user nova-compute[82009]: WARNING nova.compute.manager [req-345f9b91-5b0d-4641-ba5b-15e484dfa50e req-9b6efb6e-08c4-45ec-a472-a0d36821c3cf service nova] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Received unexpected event network-vif-plugged-d2ce54aa-8057-41b6-98ca-988a0fd0491c for instance with vm_state deleted and task_state None.
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:40:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:40:23 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:23 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:23 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:40:25 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:40:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238420.4569106, a0d74109-f1ce-4361-a037-d23d348f8d3d => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:40:35 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] VM Stopped (Lifecycle Event)
Apr 11 18:40:35 user nova-compute[82009]: DEBUG nova.compute.manager [None req-16db1e9f-6d39-49f6-887e-c85fae992757 None None] [instance: a0d74109-f1ce-4361-a037-d23d348f8d3d] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:40:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:40:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:40:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:41:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:05 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:08 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-changed-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG nova.compute.manager [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Refreshing instance network info cache due to event network-changed-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Acquiring lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Acquired lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Refreshing network info cache for port 83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updated VIF entry in instance network info cache for port 83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG nova.network.neutron [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updating instance_info_cache with network_info: [{"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-e9706ab0-b2a3-468c-86cb-ab101cbab577 req-9bb705a4-c2cd-4e1a-a571-9738865be52f service nova] Releasing lock "refresh_cache-d2623107-c830-4c81-a534-b5d7dc0ca10f" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:41:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:16 user nova-compute[82009]: INFO nova.compute.manager [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Attaching volume b266c6f4-cc30-408d-8d0c-85af691ff17b to /dev/vdb
Apr 11 18:41:16 user nova-compute[82009]: DEBUG os_brick.utils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8302b4f2-f964-4c79-a7d6-52f7eee81c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:16 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[13105326-cab4-4dad-a675-4c12a03b5fb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[848ba0a2-6822-4b22-b88a-2de0dcbd65d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[612a8aab-a08d-4b39-9b8c-1e5922501cef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:41:17 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b3af8-13e0-4e74-b0bb-019966766226]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG os_brick.utils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updating existing volume attachment record: a17e831b-c8e6-4268-bfb5-b281bc22162c {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:41:17 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid f692dcf6-6347-40f3-9e6a-cff075a18370 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:41:18 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updating instance_info_cache with network_info: [{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:41:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:41:18 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:41:20 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:21 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrVKstyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:41:22 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:41:22 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:41:22 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:41:22 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:41:22 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=26.301204681396484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea11153-657b-476d-891f-33ebc6dfcb29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:41:22 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f4ed4-407a-4de0-861d-f447a55e9390]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b] added
Apr 11 18:41:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[16333f39-710c-4618-a916-0613ca780d67]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a674c7-c8d6-463b-a000-3c25e271af10]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrVKstyw {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrVKstyw" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8c358-e0b5-4992-89ce-4c5293c25d22]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrVKstyw'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be6d10-c546-4234-a833-121657da9a64]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc090bb3-1739-4ce4-a379-ba7fb9156a49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:41:22 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:41:22 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:41:22 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:41:22 user nova-compute[82009]: 
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abe5f0a-215e-41dc-b0c8-0040df73b91b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260]
Apr 11 18:41:22 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260] successful.
Apr 11 18:41:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c6b5b-b3cb-4bfd-a436-f9dcb3162539]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc2d57-ddf9-45aa-9654-7c3554dad8b0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b (non-flash)
Apr 11 18:41:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b (non-flash)
Apr 11 18:41:22 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance d2623107-c830-4c81-a534-b5d7dc0ca10f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1d0cfb-9672-4127-8b0e-d8843ba2b4f5]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrVKstyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:41:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:41:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:41:23 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26564646464626664', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:41:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564646464626664', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:41:23 user nova-compute[82009]: DEBUG nova.objects.instance [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:41:23 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:41:23 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:41:23 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:41:23 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:41:23 user nova-compute[82009]:   <serial>b266c6f4-cc30-408d-8d0c-85af691ff17b</serial>
Apr 11 18:41:23 user nova-compute[82009]: </disk>
Apr 11 18:41:23 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] No VIF found with MAC fa:16:3e:e4:3d:17, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-8b0fa739-5722-43da-82f7-8049b240bed7 tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.493s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:41:25 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:25 user nova-compute[82009]: INFO nova.compute.manager [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Detaching volume b266c6f4-cc30-408d-8d0c-85af691ff17b
Apr 11 18:41:25 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:41:25 user nova-compute[82009]: INFO nova.virt.block_device [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Attempting to driver detach volume b266c6f4-cc30-408d-8d0c-85af691ff17b from mountpoint /dev/vdb
Apr 11 18:41:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Attempting to detach device vdb from instance d2623107-c830-4c81-a534-b5d7dc0ca10f from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:41:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:41:25 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:41:25 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:41:25 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:41:25 user nova-compute[82009]:   <serial>b266c6f4-cc30-408d-8d0c-85af691ff17b</serial>
Apr 11 18:41:25 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:41:25 user nova-compute[82009]: </disk>
Apr 11 18:41:25 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:41:25 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully detached device vdb from instance d2623107-c830-4c81-a534-b5d7dc0ca10f from the persistent domain config.
Apr 11 18:41:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2623107-c830-4c81-a534-b5d7dc0ca10f from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:41:25 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:41:25 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:41:25 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:41:25 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:41:25 user nova-compute[82009]:   <serial>b266c6f4-cc30-408d-8d0c-85af691ff17b</serial>
Apr 11 18:41:25 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:41:25 user nova-compute[82009]: </disk>
Apr 11 18:41:25 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238486.2783775, d2623107-c830-4c81-a534-b5d7dc0ca10f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:41:26 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully detached device vdb from instance d2623107-c830-4c81-a534-b5d7dc0ca10f from the live domain config.
Apr 11 18:41:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrVKstyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:41:26 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bbe32a-0575-4ca5-9e20-40be1f8cf0ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:41:26 user nova-compute[82009]: No targets found.
Apr 11 18:41:26 user nova-compute[82009]: iSNS:
Apr 11 18:41:26 user nova-compute[82009]: No targets found.
Apr 11 18:41:26 user nova-compute[82009]: STATIC:
Apr 11 18:41:26 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b
Apr 11 18:41:26 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:41:26 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:41:26 user nova-compute[82009]: FIRMWARE:
Apr 11 18:41:26 user nova-compute[82009]: No targets found.
Apr 11 18:41:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:41:26 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:41:26 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd1703-1870-4457-9106-636303eb3e23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76368dc-01df-4451-96e7-6affe68308d2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b (non-flash)
Apr 11 18:41:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b (non-flash)
Apr 11 18:41:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e01aa830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[617850f2-e3b0-477f-b119-5249a213a924]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[75df0323-ba56-41e4-909a-179e9b3a6acc]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bceb46e-0929-4266-adff-9fe358461314]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[36444d7d-53af-477c-a35e-1b561c667cd9]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72a365-4170-4323-a48b-2a19cf30ba0b]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb6d811-dd8e-4275-8b9d-d824b66ec022]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260]
Apr 11 18:41:26 user nova-compute[82009]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b, portal: 172.16.0.220,3260] successful.
Apr 11 18:41:26 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b266c6f4-cc30-408d-8d0c-85af691ff17b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3ada06-c2f0-400f-9199-8055c2cf834d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] <== disconnect_volume: return (303ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:41:26 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:41:27 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'flavor' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:41:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7c433344-5273-4163-b7be-54cf82476b7c tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.585s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:27 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:41:30 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:41:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:40 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:41:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:45 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:49 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:50 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:52 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:52 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Starting instance... {{(pid=82009) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82009) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 18:41:53 user nova-compute[82009]: INFO nova.compute.claims [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Claim successful on node user
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Start building networks asynchronously for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Allocating IP information in the background. {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] allocate_for_instance() {{(pid=82009) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 18:41:53 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Start building block device mappings for instance. {{(pid=82009) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.policy [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fc3759f9d3f4ee987d60c348c755125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ae48f804e842e6818a90b8e1f61883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82009) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Start spawning the instance on the hypervisor. {{(pid=82009) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Creating instance directory {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 18:41:53 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Creating image(s)
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "/opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "/opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "/opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.185s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.131s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk 1073741824 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585,backing_fmt=raw /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk 1073741824" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "a22ecdacd2bd0938099c60832ac89dcf2fa21585" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:53 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585 --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk. size=1073741824 {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.virt.disk.api [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Cannot resize image /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk to a smaller size. {{(pid=82009) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'migration_context' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Created local disks {{(pid=82009) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Ensure instance console log exists: /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/console.log {{(pid=82009) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Successfully created port: c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 18:41:54 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Successfully updated port: c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Building network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-changed-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Refreshing instance network info cache due to event network-changed-c5144516-ee85-4c97-b379-5e7300e428cb. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Instance cache missing network info. {{(pid=82009) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.neutron [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Instance network_info: |[{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82009) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.neutron [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Refreshing network info cache for port c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Start _get_guest_xml network_info=[{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '6a1872eb-6a9a-4f78-b970-289fd877ea0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 18:41:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:41:55 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82009) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T18:07:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T18:06:14Z,direct_url=<?>,disk_format='qcow2',id=6a1872eb-6a9a-4f78-b970-289fd877ea0f,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fe2a05d643624bb4b15cf9e4ce303e53',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T18:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flavor limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Image limits 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flavor pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Image pref 0:0:0 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82009) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Got 1 possible topologies {{(pid=82009) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.hardware [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82009) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-995235225',display_name='tempest-SnapshotDataIntegrityTests-server-995235225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-995235225',id=47,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj4/a+30dtxmR6MUGwhoEYl8GIifPSNIynSaRLlu0oZvvc9/Zq+95CzpvMcSufeKo5wuH2TpcRMZQgr+7JiHjvAiErWC8TcY8YRD3cd+zkwp4RjBIgmlIzB4PYe3WN0SA==',key_name='tempest-SnapshotDataIntegrityTests-1238772409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24ae48f804e842e6818a90b8e1f61883',ramdisk_id='',reservation_id='r-ws3vxf9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1628398246',owner_user_name='tempest-SnapshotDataIntegrityTests-1628398246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:41:53Z,user_data=None,user_id='6fc3759f9d3f4ee987d60c348c755125',uuid=2beac0ff-4330-460f-b7c0-1c3ed9decfd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82009) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Converting VIF {"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'pci_devices' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 18:41:55 user nova-compute[82009]:   <uuid>2beac0ff-4330-460f-b7c0-1c3ed9decfd5</uuid>
Apr 11 18:41:55 user nova-compute[82009]:   <name>instance-0000002f</name>
Apr 11 18:41:55 user nova-compute[82009]:   <memory>131072</memory>
Apr 11 18:41:55 user nova-compute[82009]:   <vcpu>1</vcpu>
Apr 11 18:41:55 user nova-compute[82009]:   <metadata>
Apr 11 18:41:55 user nova-compute[82009]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 18:41:55 user nova-compute[82009]:       <nova:package version="0.0.0"/>
Apr 11 18:41:55 user nova-compute[82009]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-995235225</nova:name>
Apr 11 18:41:55 user nova-compute[82009]:       <nova:creationTime>2023-04-11 18:41:55</nova:creationTime>
Apr 11 18:41:55 user nova-compute[82009]:       <nova:flavor name="m1.nano">
Apr 11 18:41:55 user nova-compute[82009]:         <nova:memory>128</nova:memory>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:disk>1</nova:disk>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:swap>0</nova:swap>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:vcpus>1</nova:vcpus>
Apr 11 18:41:55 user nova-compute[82009]:       </nova:flavor>
Apr 11 18:41:55 user nova-compute[82009]:       <nova:owner>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:user uuid="6fc3759f9d3f4ee987d60c348c755125">tempest-SnapshotDataIntegrityTests-1628398246-project-member</nova:user>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:project uuid="24ae48f804e842e6818a90b8e1f61883">tempest-SnapshotDataIntegrityTests-1628398246</nova:project>
Apr 11 18:41:55 user nova-compute[82009]:       </nova:owner>
Apr 11 18:41:55 user nova-compute[82009]:       <nova:root type="image" uuid="6a1872eb-6a9a-4f78-b970-289fd877ea0f"/>
Apr 11 18:41:55 user nova-compute[82009]:       <nova:ports>
Apr 11 18:41:55 user nova-compute[82009]:         <nova:port uuid="c5144516-ee85-4c97-b379-5e7300e428cb">
Apr 11 18:41:55 user nova-compute[82009]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 18:41:55 user nova-compute[82009]:         </nova:port>
Apr 11 18:41:55 user nova-compute[82009]:       </nova:ports>
Apr 11 18:41:55 user nova-compute[82009]:     </nova:instance>
Apr 11 18:41:55 user nova-compute[82009]:   </metadata>
Apr 11 18:41:55 user nova-compute[82009]:   <sysinfo type="smbios">
Apr 11 18:41:55 user nova-compute[82009]:     <system>
Apr 11 18:41:55 user nova-compute[82009]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 18:41:55 user nova-compute[82009]:       <entry name="product">OpenStack Nova</entry>
Apr 11 18:41:55 user nova-compute[82009]:       <entry name="version">0.0.0</entry>
Apr 11 18:41:55 user nova-compute[82009]:       <entry name="serial">2beac0ff-4330-460f-b7c0-1c3ed9decfd5</entry>
Apr 11 18:41:55 user nova-compute[82009]:       <entry name="uuid">2beac0ff-4330-460f-b7c0-1c3ed9decfd5</entry>
Apr 11 18:41:55 user nova-compute[82009]:       <entry name="family">Virtual Machine</entry>
Apr 11 18:41:55 user nova-compute[82009]:     </system>
Apr 11 18:41:55 user nova-compute[82009]:   </sysinfo>
Apr 11 18:41:55 user nova-compute[82009]:   <os>
Apr 11 18:41:55 user nova-compute[82009]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 18:41:55 user nova-compute[82009]:     <boot dev="hd"/>
Apr 11 18:41:55 user nova-compute[82009]:     <smbios mode="sysinfo"/>
Apr 11 18:41:55 user nova-compute[82009]:   </os>
Apr 11 18:41:55 user nova-compute[82009]:   <features>
Apr 11 18:41:55 user nova-compute[82009]:     <acpi/>
Apr 11 18:41:55 user nova-compute[82009]:     <apic/>
Apr 11 18:41:55 user nova-compute[82009]:     <vmcoreinfo/>
Apr 11 18:41:55 user nova-compute[82009]:   </features>
Apr 11 18:41:55 user nova-compute[82009]:   <clock offset="utc">
Apr 11 18:41:55 user nova-compute[82009]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 18:41:55 user nova-compute[82009]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 18:41:55 user nova-compute[82009]:     <timer name="hpet" present="no"/>
Apr 11 18:41:55 user nova-compute[82009]:   </clock>
Apr 11 18:41:55 user nova-compute[82009]:   <cpu mode="custom" match="exact">
Apr 11 18:41:55 user nova-compute[82009]:     <model>Nehalem</model>
Apr 11 18:41:55 user nova-compute[82009]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 18:41:55 user nova-compute[82009]:   </cpu>
Apr 11 18:41:55 user nova-compute[82009]:   <devices>
Apr 11 18:41:55 user nova-compute[82009]:     <disk type="file" device="disk">
Apr 11 18:41:55 user nova-compute[82009]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 18:41:55 user nova-compute[82009]:       <source file="/opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk"/>
Apr 11 18:41:55 user nova-compute[82009]:       <target dev="vda" bus="virtio"/>
Apr 11 18:41:55 user nova-compute[82009]:     </disk>
Apr 11 18:41:55 user nova-compute[82009]:     <interface type="ethernet">
Apr 11 18:41:55 user nova-compute[82009]:       <mac address="fa:16:3e:08:b2:07"/>
Apr 11 18:41:55 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:41:55 user nova-compute[82009]:       <mtu size="1442"/>
Apr 11 18:41:55 user nova-compute[82009]:       <target dev="tapc5144516-ee"/>
Apr 11 18:41:55 user nova-compute[82009]:     </interface>
Apr 11 18:41:55 user nova-compute[82009]:     <serial type="pty">
Apr 11 18:41:55 user nova-compute[82009]:       <log file="/opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/console.log" append="off"/>
Apr 11 18:41:55 user nova-compute[82009]:     </serial>
Apr 11 18:41:55 user nova-compute[82009]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 18:41:55 user nova-compute[82009]:     <video>
Apr 11 18:41:55 user nova-compute[82009]:       <model type="virtio"/>
Apr 11 18:41:55 user nova-compute[82009]:     </video>
Apr 11 18:41:55 user nova-compute[82009]:     <rng model="virtio">
Apr 11 18:41:55 user nova-compute[82009]:       <backend model="random">/dev/urandom</backend>
Apr 11 18:41:55 user nova-compute[82009]:     </rng>
Apr 11 18:41:55 user nova-compute[82009]:     <controller type="usb" index="0" model="none"/>
Apr 11 18:41:55 user nova-compute[82009]:     <memballoon model="virtio">
Apr 11 18:41:55 user nova-compute[82009]:       <stats period="10"/>
Apr 11 18:41:55 user nova-compute[82009]:     </memballoon>
Apr 11 18:41:55 user nova-compute[82009]:   </devices>
Apr 11 18:41:55 user nova-compute[82009]: </domain>
Apr 11 18:41:55 user nova-compute[82009]:  {{(pid=82009) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-995235225',display_name='tempest-SnapshotDataIntegrityTests-server-995235225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-995235225',id=47,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj4/a+30dtxmR6MUGwhoEYl8GIifPSNIynSaRLlu0oZvvc9/Zq+95CzpvMcSufeKo5wuH2TpcRMZQgr+7JiHjvAiErWC8TcY8YRD3cd+zkwp4RjBIgmlIzB4PYe3WN0SA==',key_name='tempest-SnapshotDataIntegrityTests-1238772409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24ae48f804e842e6818a90b8e1f61883',ramdisk_id='',reservation_id='r-ws3vxf9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1628398246',owner_user_name='tempest-SnapshotDataIntegrityTests-1628398246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T18:41:53Z,user_data=None,user_id='6fc3759f9d3f4ee987d60c348c755125',uuid=2beac0ff-4330-460f-b7c0-1c3ed9decfd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Converting VIF {"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG os_vif [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee') {{(pid=82009) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5144516-ee, may_exist=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5144516-ee, col_values=(('external_ids', {'iface-id': 'c5144516-ee85-4c97-b379-5e7300e428cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b2:07', 'vm-uuid': '2beac0ff-4330-460f-b7c0-1c3ed9decfd5'}),)) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:55 user nova-compute[82009]: INFO os_vif [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee')
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:41:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No VIF found with MAC fa:16:3e:08:b2:07, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:41:56 user nova-compute[82009]: DEBUG nova.network.neutron [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated VIF entry in instance network info cache for port c5144516-ee85-4c97-b379-5e7300e428cb. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:41:56 user nova-compute[82009]: DEBUG nova.network.neutron [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:41:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-49c8968e-aca6-48ed-ae69-772ab539c85d req-e442118c-5f42-4340-ad0a-adaa01dec39c service nova] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:41:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG nova.compute.manager [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] No waiting events found dispatching network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:41:57 user nova-compute[82009]: WARNING nova.compute.manager [req-18c8fad0-2450-41a4-9671-7c97e7fb3d45 req-4dfcd570-a93e-4b3c-9ce9-e61fa9c56cea service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received unexpected event network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb for instance with vm_state building and task_state spawning.
Apr 11 18:41:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238519.0322185, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => Resumed> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] VM Resumed (Lifecycle Event)
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Instance event wait completed in 0 seconds for  {{(pid=82009) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Guest created on hypervisor {{(pid=82009) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Instance spawned successfully.
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Found default for hw_cdrom_bus of ide {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Found default for hw_disk_bus of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Found default for hw_input_bus of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Found default for hw_pointer_model of None {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Found default for hw_video_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Found default for hw_vif_model of virtio {{(pid=82009) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.virt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Emitting event <LifecycleEvent: 1681238519.0335572, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => Started> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] VM Started (Lifecycle Event)
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] No waiting events found dispatching network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:41:59 user nova-compute[82009]: WARNING nova.compute.manager [req-8fb6c4e8-608d-42cf-aa10-e94641ed3d4e req-930c208d-b350-4975-b4ac-670f466ccf28 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received unexpected event network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb for instance with vm_state building and task_state spawning.
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82009) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.compute.manager [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 11 18:41:59 user nova-compute[82009]: DEBUG nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:41:59 user nova-compute[82009]: INFO nova.compute.manager [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Took 6.22 seconds to build instance.
Apr 11 18:41:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f4c2e45d-33b2-4ae1-98bc-9113f3ebc2cb tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.316s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:00 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:05 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:15 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:16 user nova-compute[82009]: INFO nova.compute.manager [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Terminating instance
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.compute.manager [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-vif-unplugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] No waiting events found dispatching network-vif-unplugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.compute.manager [req-adfd228c-a45d-4511-b057-122ea48a12a0 req-fe6d3aed-afbe-42f2-b6e7-c7489bf9c605 service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-vif-unplugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:42:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Instance destroyed successfully.
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.objects.instance [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lazy-loading 'resources' on Instance uuid d2623107-c830-4c81-a534-b5d7dc0ca10f {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1928714156',display_name='tempest-AttachVolumeNegativeTest-server-1928714156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1928714156',id=46,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqjtlcvFTOedW1tCltpV4NHM/VDv1sc6WJxf/MgmIAxMR51lkgELeDrhXhArbJRvpPAA3hKYozM1eCrhx/nOdUEQZ0SRgpKm30preBDIvt3XYB9AP5jIp2h9nLW+gtikQ==',key_name='tempest-keypair-994113133',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:39:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a92ba4ae3f244cfc9f3f0732ab9cc649',ramdisk_id='',reservation_id='r-l0erruyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1806714760',owner_user_name='tempest-AttachVolumeNegativeTest-1806714760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b91adf882c384c8c9e27a24a8c55b0a1',uuid=d2623107-c830-4c81-a534-b5d7dc0ca10f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converting VIF {"id": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "address": "fa:16:3e:e4:3d:17", "network": {"id": "3f8e56ff-5c92-4875-898e-96328ce084d7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-267138540-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92ba4ae3f244cfc9f3f0732ab9cc649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e4de5d-dc", "ovs_interfaceid": "83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG os_vif [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83e4de5d-dc, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:42:16 user nova-compute[82009]: INFO os_vif [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6,network=Network(3f8e56ff-5c92-4875-898e-96328ce084d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e4de5d-dc')
Apr 11 18:42:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Deleting instance files /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f_del
Apr 11 18:42:16 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Deletion of /opt/stack/data/nova/instances/d2623107-c830-4c81-a534-b5d7dc0ca10f_del complete
Apr 11 18:42:17 user nova-compute[82009]: INFO nova.compute.manager [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 11 18:42:17 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:42:17 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Took 0.78 seconds to deallocate network for instance.
Apr 11 18:42:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:42:17 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:42:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:18 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Deleted allocations for instance d2623107-c830-4c81-a534-b5d7dc0ca10f
Apr 11 18:42:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-9e65cd9a-4f63-48ba-aadf-4c3af702e96b tempest-AttachVolumeNegativeTest-1806714760 tempest-AttachVolumeNegativeTest-1806714760-project-member] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.938s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:18 user nova-compute[82009]: DEBUG nova.compute.manager [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:42:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Acquiring lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:18 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] Lock "d2623107-c830-4c81-a534-b5d7dc0ca10f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:18 user nova-compute[82009]: DEBUG nova.compute.manager [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] No waiting events found dispatching network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:42:18 user nova-compute[82009]: WARNING nova.compute.manager [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received unexpected event network-vif-plugged-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 for instance with vm_state deleted and task_state None.
Apr 11 18:42:18 user nova-compute[82009]: DEBUG nova.compute.manager [req-ad2530a3-e25c-4186-ac4f-7d111f50f3b6 req-0f5fca62-40d0-43ae-af88-2d4b2a21c0ac service nova] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Received event network-vif-deleted-83e4de5d-dcd6-46f2-b7e6-7d7ab62edca6 {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:42:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:42:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:42:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:42:22 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:42:23 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:42:23 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:42:23 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=26.273883819580078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:42:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:42:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:42:25 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:25 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:25 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:25 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:42:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:27 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:28 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:42:31 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238536.9315407, d2623107-c830-4c81-a534-b5d7dc0ca10f => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:42:31 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] VM Stopped (Lifecycle Event)
Apr 11 18:42:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-34b1f4e7-a4ad-4dd9-94cb-372f5fae94e4 None None] [instance: d2623107-c830-4c81-a534-b5d7dc0ca10f] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:42:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:42:41 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:42:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:46 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:42:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:42:56 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:01 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:43:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:06 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:43:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:43:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:43:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:43:11 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:14 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:16 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:17 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:43:19 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid f692dcf6-6347-40f3-9e6a-cff075a18370 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:43:20 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updating instance_info_cache with network_info: [{"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:43:20 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-f692dcf6-6347-40f3-9e6a-cff075a18370" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:43:20 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:43:21 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:23 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:43:24 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:25 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:43:25 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:43:25 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=26.27185821533203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance f692dcf6-6347-40f3-9e6a-cff075a18370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:26 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:27 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:29 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:43:31 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:36 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:42 user nova-compute[82009]: INFO nova.compute.manager [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Terminating instance
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.compute.manager [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-unplugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-unplugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.compute.manager [req-070411d7-bdb4-429d-97cc-416e53535d53 req-baa17cfd-2bcd-4b91-a2e2-3f872441309c service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-unplugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Instance destroyed successfully.
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.objects.instance [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lazy-loading 'resources' on Instance uuid f692dcf6-6347-40f3-9e6a-cff075a18370 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1438556823',display_name='tempest-ServersNegativeTestJSON-server-1438556823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1438556823',id=43,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:35:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='423994357c024575acae85fb885f4069',ramdisk_id='',reservation_id='r-u4tmv6g7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1378388549',owner_user_name='tempest-ServersNegativeTestJSON-1378388549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:35:09Z,user_data=None,user_id='423f3e46d47448fb880c9eeb1281565a',uuid=f692dcf6-6347-40f3-9e6a-cff075a18370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converting VIF {"id": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "address": "fa:16:3e:a2:39:3a", "network": {"id": "84f8f0e1-c59e-49b9-8a72-ef9903971259", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2002994012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423994357c024575acae85fb885f4069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb252fb-ad", "ovs_interfaceid": "4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG os_vif [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cb252fb-ad, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:43:42 user nova-compute[82009]: INFO os_vif [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d,network=Network(84f8f0e1-c59e-49b9-8a72-ef9903971259),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb252fb-ad')
Apr 11 18:43:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Deleting instance files /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370_del
Apr 11 18:43:42 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Deletion of /opt/stack/data/nova/instances/f692dcf6-6347-40f3-9e6a-cff075a18370_del complete
Apr 11 18:43:42 user nova-compute[82009]: INFO nova.compute.manager [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 11 18:43:42 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:43:42 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:43:43 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Took 0.63 seconds to deallocate network for instance.
Apr 11 18:43:43 user nova-compute[82009]: DEBUG nova.compute.manager [req-af134b98-2f26-4a79-a1f4-9fadcf5566ca req-174cc2df-7fac-4381-8ba2-f2feaf1c44b2 service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-deleted-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:43:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:43 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Deleted allocations for instance f692dcf6-6347-40f3-9e6a-cff075a18370
Apr 11 18:43:43 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-07da02d7-e478-416d-b8c1-47fe5773a460 tempest-ServersNegativeTestJSON-1378388549 tempest-ServersNegativeTestJSON-1378388549-project-member] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.630s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:43:44 user nova-compute[82009]: WARNING nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state deleted and task_state None.
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:43:44 user nova-compute[82009]: WARNING nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state deleted and task_state None.
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:43:44 user nova-compute[82009]: WARNING nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state deleted and task_state None.
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-unplugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-unplugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:43:44 user nova-compute[82009]: WARNING nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-unplugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state deleted and task_state None.
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Acquiring lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] Lock "f692dcf6-6347-40f3-9e6a-cff075a18370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:44 user nova-compute[82009]: DEBUG nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] No waiting events found dispatching network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:43:44 user nova-compute[82009]: WARNING nova.compute.manager [req-3692e261-1f10-4064-b065-d589db7a94d9 req-9b070064-b832-48b3-9c2b-fd45c176d2ed service nova] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Received unexpected event network-vif-plugged-4cb252fb-ad2c-41c3-b6c7-ca82f2fbdf6d for instance with vm_state deleted and task_state None.
Apr 11 18:43:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-changed-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG nova.compute.manager [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Refreshing instance network info cache due to event network-changed-c5144516-ee85-4c97-b379-5e7300e428cb. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG nova.network.neutron [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Refreshing network info cache for port c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:43:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:47 user nova-compute[82009]: INFO nova.compute.manager [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attaching volume 1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 to /dev/vdb
Apr 11 18:43:47 user nova-compute[82009]: DEBUG os_brick.utils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[44141148-c8bc-47af-8a1f-6b033b45631f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e1d65f-085b-48ae-b189-3963d639c323]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb74f17-b0d3-4606-85ed-e09935dcc6ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d027fd3-2fa4-422d-8786-3e5c8b8b9b84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:43:47 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[13130fd1-f2d5-4b5d-9df3-3f94c5cf5d83]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG os_brick.utils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating existing volume attachment record: 6b50772d-8555-4093-a89f-a8f4918e344c {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG nova.network.neutron [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated VIF entry in instance network info cache for port c5144516-ee85-4c97-b379-5e7300e428cb. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG nova.network.neutron [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-42803023-210b-4f3a-a00e-ab541eb82866 req-8949e028-eba2-43b4-98c6-a7a74730df06 service nova] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSZfypDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:43:51 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:43:51 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:43:51 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c67eb7-23e9-403e-b0ed-bdc14bbb1895]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:43:51 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69fbaf-fb08-4cdf-b3ec-88d4c5ce7ea0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7] added
Apr 11 18:43:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51cff5d-081c-4e37-bb00-269ad54a0946]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0cd98-5994-4eab-a357-f2f227392c4d]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MSZfypDR {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MSZfypDR" returned: 0 in 0.027s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514d48d-9fa8-4592-a3d2-a38c258aab37]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MSZfypDR'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[99190c95-64d2-4962-8715-12a6efa80035]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd42b0e-74b1-4377-b2ae-db5d0ddba66a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:43:51 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:43:51 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:43:51 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:43:51 user nova-compute[82009]: 
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a2579-a75d-4e72-9143-b44323911d8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260]
Apr 11 18:43:51 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260] successful.
Apr 11 18:43:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fbd255-abaa-494e-9df9-df3de4237e24]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[913dc9f9-75a0-46e6-9635-e077d6fbb885]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 (non-flash)
Apr 11 18:43:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 (non-flash)
Apr 11 18:43:51 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba5166-4d77-4785-a768-a35e0a9d4818]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:43:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSZfypDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23935396265313436', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935396265313436', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG nova.objects.instance [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:43:52 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:43:52 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:43:52 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:43:52 user nova-compute[82009]:   <serial>1b148d1b-7887-4ab7-8f6b-abdad0cc44c7</serial>
Apr 11 18:43:52 user nova-compute[82009]: </disk>
Apr 11 18:43:52 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:43:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:43:53 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No VIF found with MAC fa:16:3e:08:b2:07, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:43:53 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-ecf87739-b0a3-4b5a-b714-582ac9b870bd tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.290s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:43:57 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238622.795285, f692dcf6-6347-40f3-9e6a-cff075a18370 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:43:57 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] VM Stopped (Lifecycle Event)
Apr 11 18:43:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-5ad56417-6d85-4273-898d-4b59ba157366 None None] [instance: f692dcf6-6347-40f3-9e6a-cff075a18370] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:43:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:43:59 user nova-compute[82009]: INFO nova.compute.manager [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Detaching volume 1b148d1b-7887-4ab7-8f6b-abdad0cc44c7
Apr 11 18:43:59 user nova-compute[82009]: INFO nova.virt.block_device [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attempting to driver detach volume 1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 from mountpoint /dev/vdb
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Attempting to detach device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:43:59 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:43:59 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:43:59 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:43:59 user nova-compute[82009]:   <serial>1b148d1b-7887-4ab7-8f6b-abdad0cc44c7</serial>
Apr 11 18:43:59 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:43:59 user nova-compute[82009]: </disk>
Apr 11 18:43:59 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:43:59 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config.
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:43:59 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:43:59 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:43:59 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:43:59 user nova-compute[82009]:   <serial>1b148d1b-7887-4ab7-8f6b-abdad0cc44c7</serial>
Apr 11 18:43:59 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:43:59 user nova-compute[82009]: </disk>
Apr 11 18:43:59 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238639.5535755, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:43:59 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config.
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSZfypDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:43:59 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed6d8f-6a51-4fae-85c4-89e109fb21e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:43:59 user nova-compute[82009]: No targets found.
Apr 11 18:43:59 user nova-compute[82009]: iSNS:
Apr 11 18:43:59 user nova-compute[82009]: No targets found.
Apr 11 18:43:59 user nova-compute[82009]: STATIC:
Apr 11 18:43:59 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7
Apr 11 18:43:59 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:43:59 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:43:59 user nova-compute[82009]: FIRMWARE:
Apr 11 18:43:59 user nova-compute[82009]: No targets found.
Apr 11 18:43:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:43:59 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:43:59 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0533f2ca-2310-4db1-bc6d-5917ce207d79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d98708d-1699-4b3a-9e87-b84979bac59a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 (non-flash)
Apr 11 18:43:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 (non-flash)
Apr 11 18:43:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3e6b2d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f674bd9c-13d1-49f1-8f53-32272a464a6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075b524-f256-4eaf-8e72-abc2238d679b]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed796ef7-2d72-4585-a4db-b9bd6337c585]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8223c5b-1735-492a-aaac-ed9fb58dbe87]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472237d-6cdb-41a2-8899-fba303408dc5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[44755bb8-6d1e-4e9c-bafa-d71c9d0e8af6]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260]
Apr 11 18:43:59 user nova-compute[82009]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7, portal: 172.16.0.220,3260] successful.
Apr 11 18:43:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b148d1b-7887-4ab7-8f6b-abdad0cc44c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020be9d-dfc1-48ca-9ec6-b2505acac3fa]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== disconnect_volume: return (323ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:43:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:44:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:44:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-6cce0dc6-0713-4725-be76-04d1326b62df tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:44:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:10 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:44:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:44:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:44:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:16 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:19 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:44:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:44:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:44:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:44:22 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:44:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:44:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:44:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:44:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:44:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:44:24 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:25 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:44:25 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=26.288150787353516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:44:25 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:44:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:44:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:30 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:32 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:44:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:35 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:44:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:44:50 user nova-compute[82009]: DEBUG nova.objects.instance [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:44:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:44:51 user nova-compute[82009]: INFO nova.compute.manager [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attaching volume 242257f8-c35f-4a7c-9e16-ca31bbbbd14d to /dev/vdb
Apr 11 18:44:51 user nova-compute[82009]: DEBUG os_brick.utils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[34330a21-0f99-42bb-a982-73330d166730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076e990-be5b-4e10-aab2-bcd7bd515953]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc679121-2d6c-4400-a868-7ea84d02c6f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32814e3-fb8b-4860-a79c-62218c04f65c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:44:51 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:44:51 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a6934-5c4b-43b7-b1a7-72a4d90acd80]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG os_brick.utils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:44:51 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating existing volume attachment record: 6f1facdc-59b0-4fa8-8927-697adfab2470 {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:44:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:44:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOrDsGTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:44:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:44:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:44:55 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd69f9-a57b-4a7b-8c54-1a66b1d92ce5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:44:55 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d2ab71-649f-44b7-9511-cc760be427cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d] added
Apr 11 18:44:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e82d3b-8bec-48c9-8c97-98edc65c3a1e]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[823c575b-2dce-4b7d-b741-6d013e9683c3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WOrDsGTS {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WOrDsGTS" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ea65d7-28ae-4ae1-9d8b-ca737e5085e1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WOrDsGTS'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[23728f20-4fee-46a4-b676-4a7932b87ee9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[03df74be-a1db-4977-9648-ce86f2e647a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:44:55 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:44:55 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:44:55 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:44:55 user nova-compute[82009]: 
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fd7603-0032-4faa-8da7-32494b6ce9c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260]
Apr 11 18:44:55 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260] successful.
Apr 11 18:44:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee4fe9-aaaa-4bb2-bf19-5652ecb0e4c3]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2ae867-8e5d-4db3-8656-ce0d23093b59]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d (non-flash)
Apr 11 18:44:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d (non-flash)
Apr 11 18:44:55 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b36fe-bfae-48bd-a2ee-2b79d16f2f6f]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:44:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOrDsGTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:44:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:44:56 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23961303332626136', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:44:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961303332626136', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:44:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:44:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:44:56 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:44:56 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:44:56 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:44:56 user nova-compute[82009]:   <serial>242257f8-c35f-4a7c-9e16-ca31bbbbd14d</serial>
Apr 11 18:44:56 user nova-compute[82009]: </disk>
Apr 11 18:44:56 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:44:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:44:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:44:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No VIF found with MAC fa:16:3e:08:b2:07, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:44:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-711f9120-baae-43fc-a53b-e9482e7c1305 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.190s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:44:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:44:58 user nova-compute[82009]: INFO nova.compute.manager [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Detaching volume 242257f8-c35f-4a7c-9e16-ca31bbbbd14d
Apr 11 18:44:58 user nova-compute[82009]: INFO nova.virt.block_device [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attempting to driver detach volume 242257f8-c35f-4a7c-9e16-ca31bbbbd14d from mountpoint /dev/vdb
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Attempting to detach device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:44:58 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:44:58 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:44:58 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:44:58 user nova-compute[82009]:   <serial>242257f8-c35f-4a7c-9e16-ca31bbbbd14d</serial>
Apr 11 18:44:58 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:44:58 user nova-compute[82009]: </disk>
Apr 11 18:44:58 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:44:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config.
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:44:58 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:44:58 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:44:58 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:44:58 user nova-compute[82009]:   <serial>242257f8-c35f-4a7c-9e16-ca31bbbbd14d</serial>
Apr 11 18:44:58 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:44:58 user nova-compute[82009]: </disk>
Apr 11 18:44:58 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238698.948074, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:44:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config.
Apr 11 18:44:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOrDsGTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:44:58 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:44:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c24ced-9611-45c5-8ad4-763bf1e90b9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:44:58 user nova-compute[82009]: No targets found.
Apr 11 18:44:58 user nova-compute[82009]: iSNS:
Apr 11 18:44:58 user nova-compute[82009]: No targets found.
Apr 11 18:44:58 user nova-compute[82009]: STATIC:
Apr 11 18:44:58 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d
Apr 11 18:44:58 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:44:58 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:44:58 user nova-compute[82009]: FIRMWARE:
Apr 11 18:44:58 user nova-compute[82009]: No targets found.
Apr 11 18:44:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:44:58 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:44:58 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:44:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2349b414-9675-4967-bf1a-d1c650fa7f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ab6b08-a88b-4900-a905-0fa333e86f73]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d (non-flash)
Apr 11 18:44:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d (non-flash)
Apr 11 18:44:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c6248b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ee378-09b4-4d7f-aaf5-3b37b1f5083c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcd5886-daec-4252-9c37-d60fadd899dc]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91ca21-25d1-4641-b9c3-37a40ae88be9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e096b6-54ee-4064-ab58-031c775ed426]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb93096-1d19-44d9-aa25-0891ed83f4f9]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ba34f-4854-4044-a11a-afaca05642fd]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260]
Apr 11 18:44:59 user nova-compute[82009]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d, portal: 172.16.0.220,3260] successful.
Apr 11 18:44:59 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242257f8-c35f-4a7c-9e16-ca31bbbbd14d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca47a0-e4fa-43cf-804e-61dc63a4f4cc]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== disconnect_volume: return (298ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:44:59 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:45:00 user nova-compute[82009]: DEBUG nova.objects.instance [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:45:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-7bff4f7b-03e7-4164-8acb-da8452f68912 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:16 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:20 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:45:21 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:45:26 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:27 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:45:27 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=26.27712631225586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:29 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:29 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:45:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Verify base images {{(pid=82009) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Image id 6a1872eb-6a9a-4f78-b970-289fd877ea0f yields fingerprint a22ecdacd2bd0938099c60832ac89dcf2fa21585 {{(pid=82009) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 18:45:46 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] image 6a1872eb-6a9a-4f78-b970-289fd877ea0f at (/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585): checking
Apr 11 18:45:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] image 6a1872eb-6a9a-4f78-b970-289fd877ea0f at (/opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585): image is in use {{(pid=82009) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82009) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 is a valid instance name {{(pid=82009) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 has a disk file {{(pid=82009) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 18:45:46 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:47 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 is backed by a22ecdacd2bd0938099c60832ac89dcf2fa21585 {{(pid=82009) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db
Apr 11 18:45:47 user nova-compute[82009]: WARNING nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Unknown base file: /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Active base files: /opt/stack/data/nova/instances/_base/a22ecdacd2bd0938099c60832ac89dcf2fa21585
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Removable base files: /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618 /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1 /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232 /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06 /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/275c16ac96a821c2b0aaffb035983f891acd2618
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/62b39e59d35ba25b219d2e9cd244281371fa1def
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/91ac4c06b51d1fcc4453a2f7e20f4cc07b4a94b1
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f64dd5d69c8f66384426f236d55f6fc78a9c6232
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/63861990f2125e992ea37c57cac7e80abb79da4d
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4bfea7aae224ff3dc80e01c443b85c2c6503a06
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4ef18d0ff111f163b842a00bc6dd94b683470aa
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fb47537ccc2b0667cc911676ee08cc381e1c20db
Apr 11 18:45:47 user nova-compute[82009]: INFO nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dc1cfbdc982d9ca26872806f618bfd475f719b2a
Apr 11 18:45:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Verification complete {{(pid=82009) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 11 18:45:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Verify swap images {{(pid=82009) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 11 18:45:47 user nova-compute[82009]: DEBUG nova.virt.libvirt.imagecache [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Verify ephemeral images {{(pid=82009) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 11 18:45:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG nova.objects.instance [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:50 user nova-compute[82009]: INFO nova.compute.manager [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attaching volume 08e3c52e-193a-4f9c-bc38-3221648202f9 to /dev/vdb
Apr 11 18:45:50 user nova-compute[82009]: DEBUG os_brick.utils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[197b3b59-1d75-4e77-bec6-e52b08f2c31b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebadcfd4-dfba-4949-98b2-116e4ff5a798]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d924d-ae8f-4b10-8cca-d0c47e86c741]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53763e2a-188f-48d6-b1ce-1e7c8fc02e86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:45:50 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:45:50 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e6fcca-3f08-4100-8141-79d33bce318b]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG os_brick.utils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:45:50 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating existing volume attachment record: b15a161a-3c52-4a2c-898b-5728b6312cca {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOhiWVtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:45:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:45:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:45:54 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7530d4b7-7a0a-435a-a1bb-0acceb2197e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:45:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[972669b1-89b0-4e74-b777-b5c621e1b4f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9] added
Apr 11 18:45:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e90b44e-1c87-438c-9407-66933f85cd79]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad323353-e5ce-4392-8758-7ad41f364ad2]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOhiWVtM {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOhiWVtM" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f6b27-f02c-4d74-ac1c-732d45741118]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOhiWVtM'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8bea99-6d57-47ac-9f39-109c5067ebe7]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb84e31-d764-41e6-be32-ac512ef44b4a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:45:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:45:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:45:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:45:54 user nova-compute[82009]: 
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ee3d78-746f-4a3b-9776-ada8e47b5fb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260]
Apr 11 18:45:54 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260] successful.
Apr 11 18:45:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d713fe-77f6-484b-acd1-b330ff1fdc06]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a2b4a-034f-4c29-accf-05dd5d7343d6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 (non-flash)
Apr 11 18:45:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 (non-flash)
Apr 11 18:45:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20efb04-7245-476b-a731-f2a3520bf397]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:45:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOhiWVtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:45:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:45:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23365613066306231', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:45:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365613066306231', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:45:56 user nova-compute[82009]: DEBUG nova.objects.instance [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:45:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:45:56 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:45:56 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:45:56 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:45:56 user nova-compute[82009]:   <serial>08e3c52e-193a-4f9c-bc38-3221648202f9</serial>
Apr 11 18:45:56 user nova-compute[82009]: </disk>
Apr 11 18:45:56 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:45:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:45:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:45:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No VIF found with MAC fa:16:3e:08:b2:07, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:45:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-df7aac49-f8ec-4827-b7a8-697bc35fbcce tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.169s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:45:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:45:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:45:57 user nova-compute[82009]: INFO nova.compute.manager [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Detaching volume 08e3c52e-193a-4f9c-bc38-3221648202f9
Apr 11 18:45:57 user nova-compute[82009]: INFO nova.virt.block_device [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attempting to driver detach volume 08e3c52e-193a-4f9c-bc38-3221648202f9 from mountpoint /dev/vdb
Apr 11 18:45:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Attempting to detach device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:45:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:45:57 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:45:57 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:45:57 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:45:57 user nova-compute[82009]:   <serial>08e3c52e-193a-4f9c-bc38-3221648202f9</serial>
Apr 11 18:45:57 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:45:57 user nova-compute[82009]: </disk>
Apr 11 18:45:57 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:45:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config.
Apr 11 18:45:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:45:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:45:57 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:45:57 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:45:57 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:45:57 user nova-compute[82009]:   <serial>08e3c52e-193a-4f9c-bc38-3221648202f9</serial>
Apr 11 18:45:57 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:45:57 user nova-compute[82009]: </disk>
Apr 11 18:45:57 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:45:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238758.0095263, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:45:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config.
Apr 11 18:45:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOhiWVtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:45:58 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddfd749-d903-4668-b229-9797e4138254]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:45:58 user nova-compute[82009]: No targets found.
Apr 11 18:45:58 user nova-compute[82009]: iSNS:
Apr 11 18:45:58 user nova-compute[82009]: No targets found.
Apr 11 18:45:58 user nova-compute[82009]: STATIC:
Apr 11 18:45:58 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9
Apr 11 18:45:58 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:45:58 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:45:58 user nova-compute[82009]: FIRMWARE:
Apr 11 18:45:58 user nova-compute[82009]: No targets found.
Apr 11 18:45:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:45:58 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:45:58 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d3127-16a8-4226-949e-2e8807cc4dce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5c0e94-5c71-4d92-9f1d-036340b6106d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 (non-flash)
Apr 11 18:45:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 (non-flash)
Apr 11 18:45:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3c02b6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faaa894-554c-4b12-b040-a7520c610686]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[75896d41-55fd-468f-a815-cf1d5a89b728]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[223fc4c4-cac8-48a4-875c-510584ca77af]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b70b8-5a68-409f-92f7-d3e909b0f4d2]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0624b6-abb5-4152-afce-c2775df89f02]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e036607-59b8-4349-ac6a-dfad9bcb977d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260]
Apr 11 18:45:58 user nova-compute[82009]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9, portal: 172.16.0.220,3260] successful.
Apr 11 18:45:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e3c52e-193a-4f9c-bc38-3221648202f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[73405d22-65fe-421c-9964-0eff07b13eb1]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== disconnect_volume: return (272ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:45:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:45:59 user nova-compute[82009]: DEBUG nova.objects.instance [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:45:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-a9b9cf21-3444-4c8e-8533-3212f0dddadc tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.583s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:46:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:16 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:46:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:20 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:46:23 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:46:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 18:46:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] There are 0 instances to clean {{(pid=82009) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 18:46:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:26 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:26 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Cleaning up deleted instances with incomplete migration  {{(pid=82009) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:27 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:28 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:46:28 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:46:28 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=26.276153564453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:46:28 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing inventories for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating ProviderTree inventory for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Updating inventory in ProviderTree for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing aggregate associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, aggregates: None {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Refreshing trait associations for resource provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=82009) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:46:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:46:31 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:31 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:46:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:46:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:34 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:37 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:46:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:46:49 user nova-compute[82009]: INFO nova.compute.manager [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attaching volume 2167bcf1-6d9a-4442-9443-eebcfb42c66a to /dev/vdb
Apr 11 18:46:49 user nova-compute[82009]: DEBUG os_brick.utils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2ce6ba-5137-4294-bbad-4d3f719a639f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:15eb6afffc53\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d4c48-a9c4-4ac2-81ee-ea9cdd908854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f153e-d914-4aaa-ba2e-12032b8b19f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce680b-5b09-4867-a886-d285c36c6a7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Running cmd (subprocess): nvme version {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] 'nvme version' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] nvme not present on system {{(pid=82009) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 18:46:49 user nova-compute[82009]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 18:46:49 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffd3603-0fe6-470b-a06c-18360a5e644c]: (4, '') {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82009) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] LIGHTOS: no hostnqn found. {{(pid=82009) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG os_brick.utils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:15eb6afffc53', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:46:49 user nova-compute[82009]: DEBUG nova.virt.block_device [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating existing volume attachment record: 58a86da5-34e7-48a7-b7cc-217c650dba4f {{(pid=82009) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Calling os-brick to attach iSCSI Volume {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuyiJZel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:46:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:46:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:46:54 user nova-compute[82009]: INFO os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba18b28-6344-4e59-94ac-d0507e71cbac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 18:46:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --interface default --op new {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc462f11-8e2f-46ad-a68c-1373ace7b5d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a] added\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a] added
Apr 11 18:46:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5a447-bea5-4322-8e9a-2086311fa8aa]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccda6590-5874-425a-81c6-14449eb45590]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuyiJZel {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuyiJZel" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d1c2b-50df-4a67-9ea1-7d1e304442b8]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuyiJZel'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f170f4b-3216-4e25-9408-4575ccbdc3e5]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20d4891-fd3d-43b7-b922-6c81e28309a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:46:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 18:46:54 user nova-compute[82009]:  {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:46:54 user nova-compute[82009]: WARNING os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 18:46:54 user nova-compute[82009]: 
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --login {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680ddc1-3c2d-4c55-a313-58374fc3c9e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260]
Apr 11 18:46:54 user nova-compute[82009]: Login to [iface: default, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260] successful.
Apr 11 18:46:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf7b42-7abd-479f-8493-86a00df8a365]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac1c299-d447-4109-9ea1-c0ff8e8df8d6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a (non-flash)
Apr 11 18:46:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a (non-flash)
Apr 11 18:46:54 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to 172.16.0.220:3260 {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=82009) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82009) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0537b918-256f-44b2-96bb-8e37f4fea500]: (4, ('- - 0', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82009) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 18:46:54 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuyiJZel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82009) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 18:46:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:46:55 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23636363264383332', 'path': '/dev/sdb'} {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:46:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636363264383332', 'path': '/dev/sdb'} {{(pid=82009) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 18:46:55 user nova-compute[82009]: DEBUG nova.objects.instance [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:46:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 18:46:55 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:46:55 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:46:55 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:46:55 user nova-compute[82009]:   <serial>2167bcf1-6d9a-4442-9443-eebcfb42c66a</serial>
Apr 11 18:46:55 user nova-compute[82009]: </disk>
Apr 11 18:46:55 user nova-compute[82009]:  {{(pid=82009) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 18:46:55 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vda, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:46:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82009) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 18:46:56 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] No VIF found with MAC fa:16:3e:08:b2:07, not building metadata {{(pid=82009) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 18:46:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-f9f9c781-c658-4763-924c-954166b7372d tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.731s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:46:57 user nova-compute[82009]: INFO nova.compute.manager [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Detaching volume 2167bcf1-6d9a-4442-9443-eebcfb42c66a
Apr 11 18:46:57 user nova-compute[82009]: INFO nova.virt.block_device [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Attempting to driver detach volume 2167bcf1-6d9a-4442-9443-eebcfb42c66a from mountpoint /dev/vdb
Apr 11 18:46:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Attempting to detach device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config. {{(pid=82009) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:46:57 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:46:57 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:46:57 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:46:57 user nova-compute[82009]:   <serial>2167bcf1-6d9a-4442-9443-eebcfb42c66a</serial>
Apr 11 18:46:57 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:46:57 user nova-compute[82009]: </disk>
Apr 11 18:46:57 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:46:57 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the persistent domain config.
Apr 11 18:46:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config. {{(pid=82009) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG nova.virt.libvirt.guest [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 18:46:57 user nova-compute[82009]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 18:46:57 user nova-compute[82009]:   <source dev="/dev/sdb"/>
Apr 11 18:46:57 user nova-compute[82009]:   <target dev="vdb" bus="virtio"/>
Apr 11 18:46:57 user nova-compute[82009]:   <serial>2167bcf1-6d9a-4442-9443-eebcfb42c66a</serial>
Apr 11 18:46:57 user nova-compute[82009]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 18:46:57 user nova-compute[82009]: </disk>
Apr 11 18:46:57 user nova-compute[82009]:  {{(pid=82009) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_power_states {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Triggering sync for uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 18:46:57 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-615bea2b-a856-489f-9abd-aa64225e3032 None None] Received event <DeviceRemovedEvent: 1681238818.3715713, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82009) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.driver [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 18:46:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully detached device vdb from instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 from the live domain config.
Apr 11 18:46:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] calling os-brick to detach iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3e454c5e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuyiJZel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 18:46:58 user nova-compute[82009]: WARNING os_brick.initiator.connectors.base [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c8979e-f7c4-4834-8cfa-b865878161a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 18:46:58 user nova-compute[82009]: No targets found.
Apr 11 18:46:58 user nova-compute[82009]: iSNS:
Apr 11 18:46:58 user nova-compute[82009]: No targets found.
Apr 11 18:46:58 user nova-compute[82009]: STATIC:
Apr 11 18:46:58 user nova-compute[82009]: Target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a
Apr 11 18:46:58 user nova-compute[82009]:         Portal: 172.16.0.220:3260,-1
Apr 11 18:46:58 user nova-compute[82009]:                 Iface Name: default
Apr 11 18:46:58 user nova-compute[82009]: FIRMWARE:
Apr 11 18:46:58 user nova-compute[82009]: No targets found.
Apr 11 18:46:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 18:46:58 user nova-compute[82009]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 18:46:58 user nova-compute[82009]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82009) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a', 0)] {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a78cf75-91d2-4da7-afb5-5df105051c82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e9ee9b-e1df-43ed-857f-25dc20e4a05f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a (non-flash)\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a (non-flash)
Apr 11 18:46:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a (non-flash)
Apr 11 18:46:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd39c625120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a'): ({'sdb'}, set())}) {{(pid=82009) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Removing single pathed devices sdb {{(pid=82009) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db7c669-f6fb-4846-bee3-8f2af45b5823]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c11afa4-81e3-4c71-b493-bdfade65eb6f]: (4, ('ok\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Flushing IO for device /dev/sdb {{(pid=82009) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b28218-215a-415b-9db2-7b8db179785f]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82009) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94fbbbc-2c85-4ca3-b76e-68cb6c751bcd]: (4, ('1', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.linuxscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] SCSI volumes sdb have been removed. {{(pid=82009) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a')] {{(pid=82009) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8556a0ab-3ea7-41a2-9d08-5ed98ad8ee92]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --logout {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d0af6a-1f7a-456f-9774-431893c30a33]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260]
Apr 11 18:46:58 user nova-compute[82009]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a, portal: 172.16.0.220,3260] successful.
Apr 11 18:46:58 user nova-compute[82009]:  stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op delete {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2167bcf1-6d9a-4442-9443-eebcfb42c66a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92248) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f031349-5a09-451d-b376-356d514495b0]: (4, ('', '')) {{(pid=92248) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82009) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.base [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] <== disconnect_volume: return (295ms) None {{(pid=82009) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 18:46:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Disconnected iSCSI Volume {{(pid=82009) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 18:46:59 user nova-compute[82009]: DEBUG nova.objects.instance [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'flavor' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:46:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-cd4032b2-d062-48ea-b833-a07e9cd2dac1 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.708s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:46:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.527s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:46:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:47:02 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:47:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:07 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:47:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:12 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:13 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:17 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:18 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Forcefully refreshing network info cache for instance {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG nova.objects.instance [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lazy-loading 'info_cache' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:22 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:24 user nova-compute[82009]: DEBUG nova.network.neutron [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:47:24 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:47:24 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated the network info_cache for instance {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 18:47:24 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:27 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:28 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:28 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:29 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:47:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:47:29 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:47:29 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:47:29 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG oslo_concurrency.processutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 18:47:30 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:47:30 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=26.27518081665039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82009) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:47:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:47:32 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:32 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:47:32 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:36 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:47:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:47:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:37 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:42 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:47:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:47:47 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:52 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:55 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-changed-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:47:55 user nova-compute[82009]: DEBUG nova.compute.manager [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Refreshing instance network info cache due to event network-changed-c5144516-ee85-4c97-b379-5e7300e428cb. {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 18:47:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Acquiring lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 18:47:55 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Acquired lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 18:47:55 user nova-compute[82009]: DEBUG nova.network.neutron [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Refreshing network info cache for port c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 18:47:56 user nova-compute[82009]: DEBUG nova.network.neutron [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updated VIF entry in instance network info cache for port c5144516-ee85-4c97-b379-5e7300e428cb. {{(pid=82009) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 18:47:56 user nova-compute[82009]: DEBUG nova.network.neutron [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [{"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:47:56 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-67bfc9fa-07d6-4287-b856-f854ad82c98a req-fba0a22d-6fce-4122-97e8-09b47c2b18d2 service nova] Releasing lock "refresh_cache-2beac0ff-4330-460f-b7c0-1c3ed9decfd5" {{(pid=82009) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 18:47:57 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:47:58 user nova-compute[82009]: INFO nova.compute.manager [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Terminating instance
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.compute.manager [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Start destroying the instance on the hypervisor. {{(pid=82009) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-vif-unplugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] No waiting events found dispatching network-vif-unplugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.compute.manager [req-a963c490-7824-4188-a782-60baaf1f086b req-2c61c020-c73c-47b1-aa64-6266bca262bf service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-vif-unplugged-c5144516-ee85-4c97-b379-5e7300e428cb for instance with task_state deleting. {{(pid=82009) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 18:47:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Instance destroyed successfully.
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.objects.instance [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lazy-loading 'resources' on Instance uuid 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 {{(pid=82009) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.virt.libvirt.vif [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T18:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-995235225',display_name='tempest-SnapshotDataIntegrityTests-server-995235225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-995235225',id=47,image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj4/a+30dtxmR6MUGwhoEYl8GIifPSNIynSaRLlu0oZvvc9/Zq+95CzpvMcSufeKo5wuH2TpcRMZQgr+7JiHjvAiErWC8TcY8YRD3cd+zkwp4RjBIgmlIzB4PYe3WN0SA==',key_name='tempest-SnapshotDataIntegrityTests-1238772409',keypairs=<?>,launch_index=0,launched_at=2023-04-11T18:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24ae48f804e842e6818a90b8e1f61883',ramdisk_id='',reservation_id='r-ws3vxf9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6a1872eb-6a9a-4f78-b970-289fd877ea0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1628398246',owner_user_name='tempest-SnapshotDataIntegrityTests-1628398246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T18:41:59Z,user_data=None,user_id='6fc3759f9d3f4ee987d60c348c755125',uuid=2beac0ff-4330-460f-b7c0-1c3ed9decfd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Converting VIF {"id": "c5144516-ee85-4c97-b379-5e7300e428cb", "address": "fa:16:3e:08:b2:07", "network": {"id": "d408d034-2f25-487e-ad89-2ec213c6b021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612889200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24ae48f804e842e6818a90b8e1f61883", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5144516-ee", "ovs_interfaceid": "c5144516-ee85-4c97-b379-5e7300e428cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG nova.network.os_vif_util [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee') {{(pid=82009) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG os_vif [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee') {{(pid=82009) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5144516-ee, bridge=br-int, if_exists=True) {{(pid=82009) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 18:47:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:47:58 user nova-compute[82009]: INFO os_vif [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b2:07,bridge_name='br-int',has_traffic_filtering=True,id=c5144516-ee85-4c97-b379-5e7300e428cb,network=Network(d408d034-2f25-487e-ad89-2ec213c6b021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5144516-ee')
Apr 11 18:47:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Deleting instance files /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5_del
Apr 11 18:47:58 user nova-compute[82009]: INFO nova.virt.libvirt.driver [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Deletion of /opt/stack/data/nova/instances/2beac0ff-4330-460f-b7c0-1c3ed9decfd5_del complete
Apr 11 18:47:59 user nova-compute[82009]: INFO nova.compute.manager [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 18:47:59 user nova-compute[82009]: DEBUG oslo.service.loopingcall [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82009) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG nova.compute.manager [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Deallocating network for instance {{(pid=82009) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] deallocate_for_instance() {{(pid=82009) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG nova.network.neutron [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Updating instance_info_cache with network_info: [] {{(pid=82009) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 18:47:59 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Took 0.44 seconds to deallocate network for instance.
Apr 11 18:47:59 user nova-compute[82009]: DEBUG nova.compute.manager [req-e5fb8244-3327-4f52-8c04-fab089a76c70 req-dd661ca4-4434-4077-bbd4-4176184b6a81 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-vif-deleted-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:47:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:47:59 user nova-compute[82009]: INFO nova.scheduler.client.report [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Deleted allocations for instance 2beac0ff-4330-460f-b7c0-1c3ed9decfd5
Apr 11 18:47:59 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-454d02a4-a3b7-47b8-b3ce-a64abf6edde4 tempest-SnapshotDataIntegrityTests-1628398246 tempest-SnapshotDataIntegrityTests-1628398246-project-member] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.610s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:48:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received event network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 18:48:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Acquiring lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:48:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:48:00 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] Lock "2beac0ff-4330-460f-b7c0-1c3ed9decfd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:48:00 user nova-compute[82009]: DEBUG nova.compute.manager [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] No waiting events found dispatching network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb {{(pid=82009) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 18:48:00 user nova-compute[82009]: WARNING nova.compute.manager [req-c954bc2f-f1d9-477a-90fc-e70eeb0318e8 req-16b992d4-b6b7-4485-ae46-1b5fdb54b761 service nova] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Received unexpected event network-vif-plugged-c5144516-ee85-4c97-b379-5e7300e428cb for instance with vm_state deleted and task_state None.
Apr 11 18:48:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:48:13 user nova-compute[82009]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681238878.9445527, 2beac0ff-4330-460f-b7c0-1c3ed9decfd5 => Stopped> {{(pid=82009) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 18:48:13 user nova-compute[82009]: INFO nova.compute.manager [-] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] VM Stopped (Lifecycle Event)
Apr 11 18:48:13 user nova-compute[82009]: DEBUG nova.compute.manager [None req-53af8b40-03de-478d-844a-ec98ab284591 None None] [instance: 2beac0ff-4330-460f-b7c0-1c3ed9decfd5] Checking state {{(pid=82009) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 18:48:13 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:48:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:18 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:20 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:22 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Starting heal instance info cache {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 18:48:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Rebuilding the list of instances to heal {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 18:48:22 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Didn't find any instances for network info cache update. {{(pid=82009) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 18:48:23 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:23 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:48:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82009) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 18:48:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:48:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82009) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 18:48:28 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:29 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:29 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:30 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager.update_available_resource {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:48:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:48:30 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:48:30 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Auditing locally available compute resources for user (node: user) {{(pid=82009) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 18:48:31 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:48:31 user nova-compute[82009]: WARNING nova.virt.libvirt.driver [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 18:48:31 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=26.293895721435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82009) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82009) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG nova.compute.provider_tree [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed in ProviderTree for provider: c90f7e3d-8e75-47f9-93b3-09ecdef87e26 {{(pid=82009) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG nova.scheduler.client.report [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Inventory has not changed for provider c90f7e3d-8e75-47f9-93b3-09ecdef87e26 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82009) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG nova.compute.resource_tracker [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Compute_service record updated for user:user {{(pid=82009) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 18:48:31 user nova-compute[82009]: DEBUG oslo_concurrency.lockutils [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=82009) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 18:48:33 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:48:34 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:34 user nova-compute[82009]: DEBUG nova.compute.manager [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82009) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 18:48:37 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:38 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 18:48:38 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:43 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:48:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:48 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:51 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:53 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:54 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:48:58 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 18:49:03 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:49:08 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:49:14 user nova-compute[82009]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82009) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 18:49:15 user nova-compute[82009]: DEBUG oslo_service.periodic_task [None req-c4480c1e-6820-4274-9338-87189ccddcba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82009) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}